Huang, Yanping
- DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
DeepSeek-R1 shows an LLM can learn strong step-by-step reasoning from pure reinforcement learning, with no human-labeled reasoning examples.
2025/01/22 by DeepSeek-AI, Daya Guo, Guo, Daya +404 · 93 voices · 1715 citations
Computer Science · #Reinforcement Learning in Robotics #Data Stream Mining Techniques #Explainable Artificial Intelligence (XAI)
- DeepSeek-V3 Technical Report
2024/12/27 by DeepSeek-AI, Aixin Liu, Liu, Aixin +404 · 39 voices · 7 citations
Computer Science · Engineering · #Distributed and Parallel Computing Systems #Robotics and Automated Systems #cs.AI #cs.CL
- GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
2020/06/30 by Dmitry Lepikhin, Lepikhin, Dmitry, HyoukJoong Lee +16 · 2 voices · 265 citations
Computer Science · #Advanced Neural Network Applications #Machine Learning and Data Classification #Topic Modeling #cs.CL #cs.LG #stat.ML
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
2025/07/07 by Gheorghe Comanici, Comanici, Gheorghe, Eric Bieber +6844 · 8 voices · 1378 citations
#cs.CL #cs.AI
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
2024/05/07 by DeepSeek-AI, Aixin Liu, Bei Feng +310 · 5 voices · 249 citations
Computer Science · #Expert finding and Q&A systems #Topic Modeling #Speech and dialogue systems
- Regularized Evolution for Image Classifier Architecture Search
2018/02/05 by Esteban Real, Real, Esteban, Alok Aggarwal +5 · 2 voices · 39 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Distributed #FOS: Computer and information sciences #I.2.6 #I.5.1 #I.5.2 #Neural and Evolutionary Computing (cs.NE) #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.CV #cs.DC #cs.NE
- LaMDA: Language Models for Dialog Applications
2022/01/20 by Romal Thoppilan, Thoppilan, Romal, Daniel De Freitas +117 · 2 voices · 49 citations
#cs.CL #cs.AI
- ST-MoE: Designing Stable and Transferable Sparse Expert Models
2022/02/17 by Barret Zoph, Zoph, Barret, Irwan Bello +13 · 1 voice · 52 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Scaling Instruction-Finetuned Language Models
2022/10/20 by Hyung Won Chung, Le Hou, Chung, Hyung Won +62 · 248 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
2021/12/13 by Nan Du, Du, Nan, Yanping Huang +51 · 105 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Mixture-of-Experts with Expert Choice Routing
2022/02/18 by Yanqi Zhou, Zhou, Yanqi, Tao Lei +17 · 93 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques
- PaLM 2 Technical Report
2023/05/17 by Rohan Anil, Anil, Rohan, Andrew M. Dai +224 · 74 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Just Pick a Sign: Optimizing Deep Multitask Models with Gradient Sign Dropout
2020/10/14 by Chen Zhao, Chen, Zhao, Jiquan Ngiam +11 · 21 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Gemini: A Family of Highly Capable Multimodal Models
2023/12/19 by Gemini Robotics Team, Rohan Anil, Gemini Team +2692 · 9 voices · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #cs.AI #cs.CL #cs.CV
- GSPMD: General and Scalable Parallelization for ML Computation Graphs
2021/05/10 by Yuanzhong Xu, HyoukJoong Lee, Xu, Yuanzhong +29 · 14 citations
Computer Science · #Advanced Data Storage Technologies #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Controlled Decoding from Language Models
2023/10/25 by Mudgal, Sidharth, Lee, Jong, Ganapathy, Harish +10 · 17 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning
2022/01/28 by Lianmin Zheng, Zhuohan Li, Zheng, Lianmin +20 · 8 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
2023/02/22 by Zhuohan Li, Li, Zhuohan, Lianmin Zheng +19 · 9 citations
Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
2025/12/02 by DeepSeek-AI, Liu, Aixin, Mei, Aoxue +260 · 44 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Lifelong Language Pretraining with Distribution-Specialized Experts
2023/05/20 by Chen, Wuyang, Zhou, Yanqi, Du, Nan +4 · 7 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference
2021/09/24 by Kudugunta, Sneha, Huang, Yanping, Bapna, Ankur +4 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
2019/02/21 by Jonathan Shen, Shen, Jonathan, Patrick Nguyen +179 · 1 voice · 1 citation
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Autellix: An Efficient Serving Engine for LLM Agents as General Programs
2025/02/19 by Michael Luo, Luo, Michael, Shi, Xiaoxiang +17 · 11 citations
Computer Science · Engineering · #Mobile Agent-Based Network Management #Modular Robots and Swarm Intelligence #Advanced Manufacturing and Logistics Optimization
- Flavor Physics at the CEPC: a General Perspective
2024/12/27 by X. Ai, Wolfgang Altmannshofer, Ai, Xiaocong +234 · 8 citations
Physics and Astronomy · Engineering · #Particle physics theoretical and experimental studies #Particle Detector Development and Performance #Particle Accelerators and Free-Electron Lasers
- Brainformers: Trading Simplicity for Efficiency
2023/05/29 by Zhou, Yanqi, Du, Nan, Huang, Yanping +12 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Stylus: Automatic Adapter Selection for Diffusion Models
2024/04/29 by Luo, Michael, Wong, Justin, Trabucco, Brandon +5 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG)
- New Physics Search at the CEPC: a General Perspective
2025/05/30 by Ai, Xiaocong, Antusch, Stefan, Athron, Peter +211 · 12 citations
#FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #High Energy Physics - Phenomenology (hep-ph)
- SPAE: Semantic Pyramid AutoEncoder for Multimodal Generation with Frozen LLMs
2023/06/30 by Lijun Yu, Yu, Lijun, Yong Cheng +23 · 2 citations
Computer Science · #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
- Measurements of decay branching fractions of the Higgs boson to hadronic final states at the CEPC
2024/10/06 by Xiaotian Ma, Ma, Xiaotian, Zenan Wu +14 · 3 citations
Physics and Astronomy · #FOS: Physical sciences #High Energy Physics - Experiment (hep-ex) #High-Energy Particle Collisions Research #Particle physics theoretical and experimental studies #Quantum Chromodynamics and Particle Interactions
- Building Machine Translation Systems for the Next Thousand Languages
2022/05/09 by Ankur Bapna, Bapna, Ankur, Isaac Caswell +45 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification