Yan, Zijie

1. Upcycling Large Language Models into Mixture of Experts
   2024/10/10 by Ethan He, Abhinav Khattar, He, Ethan +17 · 20 citations
   Computer Science · #Expert finding and Q&A systems #Topic Modeling
2. NVIDIA Nemotron 3: Efficient and Open Intelligence
   2025/12/24 by NVIDIA, :, Aaron Blakeman +453 · 5 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
3. MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core
   2025/04/21 by Liu, Dennis, Yan, Zijie, Yao, Xin +15 · 5 citations
   #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
4. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
   2025/12/23 by NVIDIA, Aaron Blakeman, : +623 · 1 voice · 2 citations
   #cs.CL #cs.AI #cs.LG
5. Llama 3 Meets MoE: Efficient Upcycling
   2024/12/13 by Aditya Vavre, Vavre, Aditya, Ethan He +11 · 1 citation
   Computer Science · Medicine · #Topic Modeling #Multimodal Machine Learning Applications #Artificial Intelligence in Healthcare and Education