Wan, Xinyi
- Zero Bubble Pipeline Parallelism
2023/11/30 by Penghui Qi, Qi, Penghui, Xinyi Wan +5 · 17 citations
Computer Science · Engineering · #Parallel Computing and Optimization Techniques #Ferroelectric and Negative Capacitance Devices #Advanced Neural Network Applications
- Pipeline Parallelism with Controllable Memory
2024/05/24 by Penghui Qi, Xinyi Wan, Qi, Penghui +5 · 4 citations
Engineering · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Power System Optimization and Stability #and Cluster Computing (cs.DC)
- Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
2025/02/18 by Longxu Dou, Qian Liu, Dou, Longxu +82 · 1 voice · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #cs.AI #cs.CL #cs.LG
- Balancing Pipeline Parallelism with Vocabulary Parallelism
2024/11/08 by M. Yeung, Penghui Qi, Yeung, Man Tsung +5 · 3 citations
Computer Science · #Natural Language Processing Techniques
- PipeOffload: Improving Scalability of Pipeline Parallelism with Memory Optimization
2025/03/03 by Xinyi Wan, Wan, Xinyi, Penghui Qi +7 · 3 citations
Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)