👋 About Me
Hi, everyone! I am currently a junior undergraduate student at Harbin Institute of Technology (Weihai). I serve as a research assistant at Harbin Institute of Technology under the supervision of Prof. Dianbo Sui. Additionally, I am a visiting student at Westlake University in the LINs Lab, working under the guidance of Prof. Tao Lin.
My research interests include Deep Learning Theory, Large Language Models, Interpretability, Complex Systems, and Statistical Mechanics.
🔥 News
- 2024.09 Two papers were accepted by EMNLP 2024 Main.
📝 Publications
Structured-Initialization Learning
Deyuan Liu, Peng Sun, Xufeng Li, Tao Lin
ICLR 2025 Under Review
Pruning via Merging: Compressing LLMs via Manifold Alignment Based Layer Merging
Deyuan Liu, Zhanyue Qin, Hairu Wang, Zhao Yang, Zecheng Wang, Fangying Rong, Qingbin Liu, Yanchao Hao, Xi Chen, Cunhang Fan, Zhao Lv, Zhiying Tu, Dianhui Chu, Bo Li, Dianbo Sui
EMNLP 2024 Main
Checkpoint Merging via Bayesian Optimization in LLM Pretraining
Deyuan Liu, Zecheng Wang, Bingning Wang, Weipeng Chen, Chunshan Li, Zhiying Tu, Dianhui Chu, Bo Li, Dianbo Sui
arXiv
Enhancing LLM Pretraining by Checkpoint Merging: An Almost Free Lunch Approach
Zecheng Wang, Deyuan Liu, Chunshan Li, Dianhui Chu, Weipeng Chen, Bingning Wang, Dianbo Sui
AAAI 2025 Under Review
UNO Arena for Evaluating Sequential Reasoning of LLMs
Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui
EMNLP 2024 Main
Zhenwei Long, Peng Sun, Zhenglin Cheng, Deyuan Liu, Tao Lin
ICLR 2025 Under Review
Mitigating Gender Bias in Code Large Language Models via Model Editing
Zhanyue Qin, Haochuan Wang, Zecheng Wang, Deyuan Liu, Cunhang Fan, Zhao Lv, Zhiying Tu, Dianhui Chu, Dianbo Sui
arXiv
📖 Education
- 2022.09 - 2026.06 (Expected), Harbin Institute of Technology (Weihai). B.S. in Software Engineering.