Shangchun Zhao

1. USP: A Unified Sequence Parallelism Approach for Long Context Generative AI
   2024/05/13 by Jiarui Fang, Shangchun Zhao, Fang, Jiarui +1 · 19 citations
   Computer Science · #Neural Networks and Applications #Evolutionary Algorithms and Applications #Algorithms and Data Compression
2. LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
   2024/06/26 by Diandian Gu, Gu, Diandian, Peng Sun +25 · 9 citations
   Computer Science · #Natural Language Processing Techniques #Handwritten Text Recognition Techniques #Speech Recognition and Synthesis
3. An Adaptive Placement and Parallelism Framework for Accelerating RLHF Training
   2023/12/19 by Youshao Xiao, Zhenglei Zhou, Xiao, Youshao +15 · 7 citations
   Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Teleoperation and Haptic Systems