Research
My research interests are efficient algorithm and systems for real-world machine learning applications, especially foundation models.
|
|
Offsite-Tuning: Transfer Learning without Full Model
Guangxuan Xiao,
Ji Lin,
Song Han
arXiv
[paper]
[code]
|
|
ReFresh: Reducing Memory Access from Exploiting Stable Historical Embeddings for Graph Neural Network Training
Kezhao Huang, Haitian Jiang, Minjie Wang, Guangxuan Xiao, David Wipf, Xiang Song, Quan Gan, Zengfeng Huang, Jidong Zhai, Zheng Zhang
arXiv
[paper]
|
|
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Guangxuan Xiao*,
Ji Lin*,
Mickael Seznec,
Julien Demouth,
Song Han
arXiv
[paper]
[code]
|
|
Sparse and Local Hypergraph Reasoning Networks
Guangxuan Xiao,
Leslie Pack Kaelbling,
Jiajun Wu,
Jiayuan Mao
LOG 2022
[paper]
|
|
Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-Level Backdoor Attacks
Zhengyan Zhang*, Guangxuan Xiao*, Yongwei Li, Tian Lv, Fanchao Qi,
Zhiyuan Liu,
Yasheng Wang, Xin Jiang, Maosong Sun
ICML 2021 AdvML Workshop
[paper]
|
|
Hardware Router on RISC-V CPU
Guangxuan Xiao, Tian Lv, Zizhao Zhang
We implemented a 5-stage pipeline RV32I CPU on FPGA from scratch. Then we implemented a tiny OS
and the RIPv2 routing algorithm on the CPU, getting a high-performance IPv4 router.
[code][doc]
|
|
Realistic Rendering based on Path Tracing and Photon Mapping
I implemented a realistic rendering engine using path tracing and stochastic progressive photon
mapping algorithms, boosted with bounding boxes, hierarchical KD-Tree, CUDA, and OpenMP.
[code]
|
|
Recognizing, Detecting and Generating Oracle Characters with Deep Learning
Guangxuan Xiao, Yongwei Li, Tian Lv
We proposed a well-organized oracle characters dataset and a novel data augmentation method to
detect oracle characters from raw oracle bones. We implemented generative adversarial networks (GANs)
to generate and complete oracle characters.
|
 |
Massachusetts Institute of Technology
2022.08 - Present
Ph.D student in Computer Science
Advisor: Prof. Song Han
|
 |
Tsinghua University
2018.08 - 2022.07
B.Eng. in Computer Science
B.Econ. in Economics (Second Major)
Advisor: Prof. Zhiyuan Liu, Prof. Jidong Zhai
|
 |
Stanford University
2020.07 - 2021.06
Visiting Research Student
Advisor: Prof. Jure Leskovec
Mentor: Jiaxuan You
|
 |
Stanford University
2021.06 - 2021.11
Visiting Research Student through the UGVR
program
Advisor: Prof. Jiajun Wu, Prof. Leslie Pack Kaelbling
Mentor: Jiayuan Mao
|
Honors & Awards
- Tsinghua Comprehensive Excellence Scholarship, 2019
- National Scholarship, 2020
- Boeing Scholarship, 2021
- SenseTime Scholarship, 2021
- Tsinghua "Future Scholar" Scientific Research Grant (30000$), 2021
- Contemporary Undergraduate Mathematical Contest in Modeling, 1st Prize, 2020
- Beijing "Challenge Cup" Academic Science and Technology Competition, 1st Prize, 2020
|
Miscellaneous
I love to play soccer. I was the captain and striker of my department soccer team.
I also love to play table tennis, Go (Weiqi), and piano. Beethoven's works are my favorite.
|
|