Li, Pingzhi
- Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy
2023/10/02 by Li, Pingzhi, Zhang, Zhenyu, Yadav, Prateek +4 · 23 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
2024/02/18 by Zhang, Yihua, Li, Pingzhi, Hong, Junyuan +10 · 14 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- QuantMoE-Bench: Examining Post-Training Quantization for Mixture-of-Experts
2024/06/12 by Pingzhi Li, Li, Pingzhi, Xiaolong Jin +6 · 6 citations
Decision Sciences · #Forecasting Techniques and Applications #Advanced Bandit Algorithms Research
- Ultrafast racetrack based on compensated Co/Gd-based synthetic ferrimagnet with all-optical switching
2022/04/25 by Pingzhi Li, Li, Pingzhi, Thomas J. Kools +5 · 2 citations
Engineering · Materials Science · Physics and Astronomy · #FOS: Physical sciences #Magnetic Properties and Applications #Magnetic properties of thin films #Magneto-Optical Properties and Applications #Mesoscale and Nanoscale Physics (cond-mat.mes-hall)
- Picosecond all-optical switching of Co/Gd based synthetic ferrimagnets
2024/06/23 by Pingzhi Li, Li, Pingzhi, Thomas J. Kools +19 · 2 citations
Engineering · Physics and Astronomy · #FOS: Physical sciences #Magnetic properties of thin films #Magneto-Optical Properties and Applications #Mesoscale and Nanoscale Physics (cond-mat.mes-hall) #Optics (physics.optics) #Photonic Crystals and Applications
- Ultralow power and shifting-discretized magnetic racetrack memory device driven by chirality switching and spin current
2023/05/08 by Shen Li, Li, Shen, Xiaoyang Lin +15 · 1 citation
Materials Science · Physics and Astronomy · #FOS: Physical sciences #Magnetic and transport properties of perovskites and related materials #Magnetic properties of thin films #Mesoscale and Nanoscale Physics (cond-mat.mes-hall) #Multiferroics and related materials
- Finding Fantastic Experts in MoEs: A Unified Study for Expert Dropping Strategies and Observations
2025/04/08 by Jaiswal, Ajay, Wang, Jianyu, Li, Yixiao +6 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Privacy-preserving Fine-tuning of Large Language Models through Flatness
2024/03/07 by Chen, Tiejin, Da, Longchao, Zhou, Huixue +4 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2
- Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild
2024/10/07 by Zhao, Xinyu, Sun, Guoheng, Cai, Ruisi +13 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- AsyncSpade: Efficient Test-Time Scaling with Asynchronous Sparse Decoding
2025/10/08 by Luo, Shuqing, Yilin Guan, Pingzhi Li +6 · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies #Advanced Neural Network Applications
- Occult: Optimizing Collaborative Communication across Experts for Accelerated Parallel MoE Training and Inference
2025/05/19 by Luo, Shuqing, Li, Pingzhi, Peng, Jie +7 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- GroverGPT: A Large Language Model with 8 Billion Parameters for Quantum Searching
2024/12/30 by Wang, Haoran, Li, Pingzhi, Chen, Min +3 · 1 citation
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Quantum Physics (quant-ph)
- Advancing MoE Efficiency: A Collaboration-Constrained Routing (C2R) Strategy for Better Expert Parallelism Design
2025/04/02 by Zhang, Mohan, Li, Pingzhi, Peng, Jie +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- DOGe: Defensive Output Generation for LLM Protection Against Knowledge Distillation
2025/05/26 by Li, Pingzhi, Tan, Zhen, Zhang, Mohan +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)