Research
My research interests are efficient algorithms and systems for real-world machine learning applications, especially foundation models.
|
|
Efficient Streaming Language Models with Attention Sinks
Guangxuan Xiao,
Yuandong Tian,
Beidi Chen,
Song Han,
Mike Lewis
arXiv
[paper]
[code]
|
|
FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
Guangxuan Xiao*,
Tianwei Yin*,
William T. Freeman,
Frédo Durand,
Song Han
arXiv
[website]
[paper]
[code]
[demo]
|
|
Offsite-Tuning: Transfer Learning without Full Model
Guangxuan Xiao,
Ji Lin,
Song Han
arXiv
[paper]
[code]
|
|
ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang
arXiv
[paper]
|
|
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Guangxuan Xiao*,
Ji Lin*,
Mickael Seznec,
Hao Wu,
Julien Demouth,
Song Han
ICML 2023
[paper]
[code]
|
|
Sparse and Local Hypergraph Reasoning Networks
Guangxuan Xiao,
Leslie Pack Kaelbling,
Jiajun Wu,
Jiayuan Mao
LOG 2022
[paper]
|
|
Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attacks
Zhengyan Zhang*, Guangxuan Xiao*, Yongwei Li, Tian Lv, Fanchao Qi,
Zhiyuan Liu,
Yasheng Wang, Xin Jiang, Maosong Sun
ICML 2021 AdvML Workshop
[paper]
|
 |
Massachusetts Institute of Technology
2022.08 - Present
Ph.D student in Computer Science
Advisor: Prof. Song Han
|
 |
Tsinghua University
2018.08 - 2022.07
B.Eng. in Computer Science
B.Econ. in Economics (Second Major)
Advisor: Prof. Zhiyuan Liu, Prof. Jidong Zhai
|
 |
Stanford University
2020.07 - 2021.06
Visiting Research Student
Advisor: Prof. Jure Leskovec
Mentor: Jiaxuan You
|
 |
Stanford University
2021.06 - 2021.11
Visiting Research Student through the UGVR
program
Advisor: Prof. Jiajun Wu, Prof. Leslie Pack Kaelbling
Mentor: Jiayuan Mao
|
Honors & Awards
- Hewlett Packard Fellowship, 2022
- SenseTime Scholarship, 2021
- Boeing Scholarship, 2021
- Tsinghua "Future Scholar" Scientific Research Grant (30000$), 2021
- National Scholarship, 2020
- Contemporary Undergraduate Mathematical Contest in Modeling, 1st Prize, 2020
- Beijing "Challenge Cup" Academic Science and Technology Competition, 1st Prize, 2020
- Tsinghua Comprehensive Excellence Scholarship, 2019
|
Miscellaneous
I love to play soccer. I was the captain and striker of my department soccer team.
I also love to play table tennis, Go (Weiqi), and piano. Beethoven's works are my favorite.
|
|