Xinyi Wan
- Zero Bubble Pipeline Parallelism
2023/11/30 by Penghui Qi, Xinyi Wan, Qi, Penghui +5 · 14 citations
Computer Science · Engineering · #Parallel Computing and Optimization Techniques #Ferroelectric and Negative Capacitance Devices #Advanced Neural Network Applications
- Pipeline Parallelism with Controllable Memory
2024/05/24 by Penghui Qi, Xinyi Wan, Qi, Penghui +5 · 4 citations
Engineering · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Power System Optimization and Stability #and Cluster Computing (cs.DC)
- Balancing Pipeline Parallelism with Vocabulary Parallelism
2024/11/08 by M. Yeung, Yeung, Man Tsung, Penghui Qi +5 · 2 citations
Computer Science · #Natural Language Processing Techniques
- Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
2025/02/18 by Longxu Dou, Dou, Longxu, Qian Liu +73 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques