Zhang, Chengming

1. DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
   2023/09/25 by Sam Adé Jacobs, Masahiro Tanaka, Jacobs, Sam Ade +11 · 54 citations
   Computer Science · Engineering · #Topic Modeling #Ferroelectric and Negative Capacitance Devices #Natural Language Processing Techniques
2. DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
   2023/10/06 by Shuaiwen Leon Song, Bonnie Kruft, Song, Shuaiwen Leon +181 · 5 citations
   Biochemistry, Genetics and Molecular Biology · Decision Sciences · Materials Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Genetics, Bioinformatics, and Biomedical Research #Machine Learning (cs.LG) #Machine Learning in Materials Science #Scientific Computing and Data Management
3. RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition
   2020/02/19 by Peiyan Dong, Dong, Peiyan, Siyue Wang +19 · 4 citations
   Computer Science · #Advanced Neural Network Applications #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Neural Networks and Applications #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
4. Domino: Eliminating Communication in LLM Training via Generic Tensor Slicing and Overlapping
   2024/09/23 by Guanhua Wang, Wang, Guanhua, Chengming Zhang +6 · 5 citations
   Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
5. SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training
   2024/10/20 by Jinda Jia, Jia, Jinda, Cong Xie +19 · 5 citations
   Computer Science · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
6. KVComp: A High-Performance, LLM-Aware, Lossy Compression Framework for KV Cache
   2025/08/30 by Bo Jiang, Taolue Yang, Jiang, Bo +9 · 1 voice · 1 citation
   Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.DC
7. AdaCM²: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction
   2024/11/19 by Yuanbin Man, Ying Huang, Man, Yuanbin +9 · 2 citations
   Computer Science · #Advanced Data Compression Techniques #Image and Signal Denoising Methods #Advanced Image Processing Techniques
8. COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compression
   2021/11/18 by Jin, Sian, Zhang, Chengming, Jiang, Xintong +5 · 1 citation
   #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)