Li, Conglong

1. Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
   2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1393 citations
   #cs.CL #cs.AI
2. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
   2022/11/09 by Workshop, BigScience, :, Scao, Teven Le +391 · 125 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences
3. DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
   2022/01/14 by Rajbhandari, Samyam, Li, Conglong, Yao, Zhewei +5 · 79 citations
   #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
4. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
   2022/06/04 by Yao, Zhewei, Aminabadi, Reza Yazdani, Zhang, Minjia +3 · 61 citations
   #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
5. DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
   2023/08/02 by Zhewei Yao, Reza Yazdani Aminabadi, Yao, Zhewei +35 · 16 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
6. The Stability-Efficiency Dilemma: Investigating Sequence Length Warmup for Training GPT Models
   2021/08/13 by Conglong Li, Li, Conglong, Minjia Zhang +3 · 6 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Domain Adaptation and Few-Shot Learning
7. Scaling Video Analytics on Constrained Edge Nodes
   2019/05/24 by Canel, Christopher, Kim, Thomas, Zhou, Giulio +5 · 4 citations
   #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Performance (cs.PF) #electronic engineering #information engineering
8. DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
   2023/10/06 by Shuaiwen Leon Song, Bonnie Kruft, Song, Shuaiwen Leon +181 · 5 citations
   Biochemistry, Genetics and Molecular Biology · Decision Sciences · Materials Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Genetics, Bioinformatics, and Biomedical Research #Machine Learning (cs.LG) #Machine Learning in Materials Science #Scientific Computing and Data Management
9. DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing
   2022/12/07 by Conglong Li, Li, Conglong, Zhewei Yao +8 · 3 citations
   Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Topic Modeling
10. 1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence Speed
    2021/02/04 by Tang, Hanlin, Gan, Shaoduo, Awan, Ammar Ahmad +6 · 2 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
11. LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs
    2024/07/04 by LLM-Jp, :, Aizawa, Akiko +80 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences