Songtao Liu (刘松涛)

---

[Github]   [X]
Email: soughingliu@gmail.com

My current research focuses on full attention mechanisms for large language models, with the goal of reducing inference cost.

Selected Publications (* denotes equal contribution)

For a full list of publications, please see my Google Scholar.

• Multi-Head Low-Rank Attention
  Songtao Liu, Hongwu Peng, Zhiwei Zhang, Zhengyu Chen, Yue Guo
  International Conference on Learning Representations (ICLR), 2026
  [arXiv] [Blog] [Code] [Weights&Data]
• Preference Optimization for Molecule Synthesis with Conditional Residual Energy-based Models
  Songtao Liu, Hanjun Dai, Peng Liu
  International Conference on Machine Learning (ICML), 2024
  Oral Presentation
  [arXiv] [Code]
• FusionRetro: Molecule Representation Fusion via In-Context Learning for Retrosynthetic Planning
  Songtao Liu, Zhengkai Tu*, Minkai Xu*, Zuobai Zhang*, Lu Lin, Rex Ying, Jian Tang, Peilin Zhao, Dinghao Wu
  International Conference on Machine Learning (ICML), 2023
  [arXiv] [Code]