Dai, Damai
- DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
DeepSeek-R1 shows an LLM can learn strong step-by-step reasoning from pure reinforcement learning, with no human-labeled reasoning examples.
2025/01/22 by DeepSeek-AI, Daya Guo, Dejian Yang +404 · 93 voices · 1689 citations
Computer Science · #Reinforcement Learning in Robotics #Data Stream Mining Techniques #Explainable Artificial Intelligence (XAI)
- Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
2025/02/16 by Jingyang Yuan, Yuan, Jingyang, Huazuo Gao +28 · 19 voices · 128 citations
Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #cs.AI #cs.CL #cs.LG
- DeepSeek-V3 Technical Report
2024/12/27 by DeepSeek-AI, Aixin Liu, Bei Feng +404 · 39 voices · 6 citations
Computer Science · Engineering · #Distributed and Parallel Computing Systems #Robotics and Automated Systems #cs.AI #cs.CL
- Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers
2022/12/20 by Damai Dai, Yutao Sun, Dai, Damai +12 · 4 voices · 50 citations
Computer Science · #Topic Modeling #Machine Learning and Data Classification #Advanced Neural Network Applications
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
2024/05/07 by DeepSeek-AI, Aixin Liu, Liu, Aixin +310 · 5 voices · 244 citations
Computer Science · #Expert finding and Q&A systems #Topic Modeling #Speech and dialogue systems
- Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures
2025/05/14 by Chenggang Zhao, Chengqi Deng, Zhao, Chenggang +27 · 8 voices · 17 citations
Computer Science · Decision Sciences · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Scientific Computing and Data Management
- A Survey on In-context Learning
2022/12/31 by Qingxiu Dong, Dong, Qingxiu, Lei Li +23 · 4 voices · 117 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
2024/12/13 by Zhiyu Wu, Wu, Zhiyu, Xiaokang Chen +51 · 3 voices · 140 citations
Computer Science · #cs.CV #cs.AI #cs.CL
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations
2023/12/14 by Wang, Peiyi, Li, Lei, Shao, Zhihong +6 · 186 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence
2024/06/17 by DeepSeek-AI, Qihao Zhu, Daya Guo +79 · 1 voice · 71 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #cs.AI #cs.LG #cs.SE #vaccines and immunoinformatics approaches
- DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
2024/01/11 by Damai Dai, Dai, Damai, Chengqi Deng +31 · 178 citations
Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
2024/01/05 by DeepSeek-AI, :, Xiao Guo Bi +170 · 111 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Knowledge Neurons in Pretrained Transformers
2021/04/18 by Dai, Damai, Dong, Li, Hao, Yaru +3 · 64 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts
2024/08/28 by Lean Wang, Wang, Lean, Huazuo Gao +7 · 52 citations
Computer Science · #Computation and Language (cs.CL) #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Privacy-Preserving Technologies in Data
- Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
2023/05/23 by Lean Wang, Lei Li, Wang, Lean +13 · 27 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- StableMoE: Stable Routing Strategy for Mixture of Experts
2022/04/18 by Damai Dai, Dong Li, Dai, Damai +11 · 15 citations
Computer Science · Physics and Astronomy · #Advanced Graph Neural Networks #Complex Network Analysis Techniques #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG)
- On the Representation Collapse of Sparse Mixture of Experts
2022/04/20 by Zewen Chi, Chi, Zewen, Dong Li +17 · 14 citations
Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
2025/12/02 by DeepSeek-AI, Liu, Aixin, Mei, Aoxue +260 · 36 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Calibrating Factual Knowledge in Pretrained Language Models
2022/10/07 by Dong, Qingxiu, Dai, Damai, Song, Yifan +3 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models
2024/07/02 by Z. Wang, Wang, Zihan, Deli Chen +9 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Large Language Models Struggle with Unreasonability in Math Problems
2024/03/28 by Jingyuan Ma, Damai Dai, Ma, Jingyuan +8 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Exploring Activation Patterns of Parameters in Language Models
2024/05/28 by Yudong Wang, Wang, Yudong, Damai Dai +3 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion
2023/05/24 by Shaoxaing Wu, Wu, Shaoxiang, Damai Dai +11 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Music and Audio Processing #Speech and Audio Processing
- LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts
2018/09/13 by Ma, Shuming, Cui, Lei, Dai, Damai +2 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Language Models Encode the Value of Numbers Linearly
2024/01/08 by Zhu, Fangwei, Dai, Damai, Sui, Zhifang · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Neural Knowledge Bank for Pretrained Transformers
2022/07/31 by Damai Dai, Wenbin Jiang, Dai, Damai +9 · 1 citation
Computer Science · #Topic Modeling #Explainable Artificial Intelligence (XAI) #Natural Language Processing Techniques
- Mixture of Experts for Biomedical Question Answering
2022/04/15 by Dai, Damai, Jiang, Wenbin, Zhang, Jiyuan +5 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning
2023/10/12 by Yang, Zhe, Dai, Damai, Wang, Peiyi +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions
2018/08/16 by Wei Li, Li, Wei, Xuancheng Ren +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text and Document Classification Technologies