Shiqing Fan

1. DAPPLE: A Pipelined Data Parallel Approach for Training Large Models
   2020/07/02 by Shiqing Fan, Fan, Shiqing, Yi Rong +23 · 16 citations
   Computer Science · Engineering · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
2. Upcycling Large Language Models into Mixture of Experts
   2024/10/10 by Ethan He, He, Ethan, Abhinav Khattar +17 · 20 citations
   Computer Science · #Expert finding and Q&A systems #Topic Modeling
3. Scalable Training of Mixture-of-Experts Models with Megatron Core
   2026/03/08 by Zijie Yan, Hongxiao Bai, Xin Yao +42 · 3 voices · 2 citations
   #cs.DC #cs.CL #cs.LG
4. An Alternative Practice of Tropical Convolution to Traditional Convolutional Neural Networks
   2021/03/03 by Shiqing Fan, Liying Liu, Fan, Shiqing +3 · 1 citation
   Computer Science · #Advanced Neural Network Applications #Computational Physics and Python Applications #Neural Networks and Applications
5. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
   2025/12/23 by NVIDIA, Aaron Blakeman, : +623 · 1 voice · 2 citations
   #cs.CL #cs.AI #cs.LG