Liu, Shengyu

1. DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving
   2024/01/18 by Yinmin Zhong, Zhong, Yinmin, Shengyu Liu +13 · 198 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
2. Fast Distributed Inference Serving for Large Language Models
   2023/05/10 by Bingyang Wu, Wu, Bingyang, Yinmin Zhong +9 · 34 citations
   Computer Science · Engineering · #Advanced Graph Neural Networks #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
3. LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism
   2024/04/15 by Bingyang Wu, Wu, Bingyang, Shengyu Liu +9 · 46 citations
   Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Topic Modeling #and Cluster Computing (cs.DC)
4. Mirage: A Multi-Level Superoptimizer for Tensor Programs
   2024/05/09 by Wu, Mengdi, Cheng, Xinhao, Liu, Shengyu +7 · 28 citations
   #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Programming Languages (cs.PL)
5. Optimizing RLHF Training for Large Language Models with Stage Fusion
   2024/09/20 by Yinmin Zhong, Zili Zhang, Zhong, Yinmin +18 · 26 citations
   Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Speech Recognition and Synthesis #Topic Modeling #and Cluster Computing (cs.DC)
6. DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
   2025/12/02 by Aixin Liu, DeepSeek-AI, Liu, Aixin +352 · 65 citations
   Computer Science · Materials Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning in Materials Science #Topic Modeling