Guangxuan Xiao   肖光烜

I am a second-year Ph.D. student at MIT EECS, advised by Prof. Song Han. I graduated from the Department of Computer Science and Technology at Tsinghua University in 2022, advised by Prof. Zhiyuan Liu and Prof. Jidong Zhai. I have been very fortunate to work with Prof. Jure Leskovec as a summer intern in 2020, with Prof. Jiajun Wu and Prof. Leslie Pack Kaelbling through the Stanford UGVR Program.

Email  /  Google Scholar  /  Github /  Linkedin

profile photo

My research interests are efficient algorithms and systems for real-world machine learning applications, especially foundation models.

Efficient Streaming Language Models with Attention Sinks
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
[paper] [code]

FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
Guangxuan Xiao*, Tianwei Yin*, William T. Freeman, Frédo Durand, Song Han
[website] [paper] [code] [demo]

Offsite-Tuning: Transfer Learning without Full Model
Guangxuan Xiao, Ji Lin, Song Han
[paper] [code]

ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Guangxuan Xiao*, Ji Lin*, Mickael Seznec, Hao Wu, Julien Demouth, Song Han
ICML 2023
[paper] [code]

Sparse and Local Hypergraph Reasoning Networks
Guangxuan Xiao, Leslie Pack Kaelbling, Jiajun Wu, Jiayuan Mao
LOG 2022

Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attacks
Zhengyan Zhang*, Guangxuan Xiao*, Yongwei Li, Tian Lv, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Xin Jiang, Maosong Sun
ICML 2021 AdvML Workshop

Massachusetts Institute of Technology
2022.08 - Present

Ph.D student in Computer Science
Advisor: Prof. Song Han
Tsinghua University
2018.08 - 2022.07

B.Eng. in Computer Science
B.Econ. in Economics (Second Major)
Advisor: Prof. Zhiyuan Liu, Prof. Jidong Zhai
Stanford University
2020.07 - 2021.06

Visiting Research Student
Advisor: Prof. Jure Leskovec
Mentor: Jiaxuan You
Stanford University
2021.06 - 2021.11

Visiting Research Student through the UGVR program
Advisor: Prof. Jiajun Wu, Prof. Leslie Pack Kaelbling
Mentor: Jiayuan Mao
Honors & Awards
  • Hewlett Packard Fellowship, 2022
  • Boeing Scholarship, 2021
  • Tsinghua "Future Scholar" Scientific Research Grant (30000$), 2021
  • National Scholarship, 2020
  • Contemporary Undergraduate Mathematical Contest in Modeling, 1st Prize, 2020
  • Beijing "Challenge Cup" Academic Science and Technology Competition, 1st Prize, 2020
  • Tsinghua Comprehensive Excellence Scholarship, 2019

I love to play soccer. I was the captain and striker of my department soccer team.
I also love to play table tennis, Go (Weiqi), and piano. Beethoven's works are my favorite.

Template adapted from Jon Barron.