Xiaodong Liu
- DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning
DeepSeek-R1 shows an LLM can learn strong step-by-step reasoning from pure reinforcement learning, with no human-labeled reasoning examples.
2025/01/22 by DeepSeek-AI, Daya Guo, Dejian Yang +404 · 93 voices · 1672 citations
Computer Science · #Reinforcement Learning in Robotics #Data Stream Mining Techniques #Explainable Artificial Intelligence (XAI)
- DeepSeek-V3 Technical Report
2024/12/27 by DeepSeek-AI, Aixin Liu, Liu, Aixin +404 · 39 voices · 6 citations
Computer Science · Engineering · #Distributed and Parallel Computing Systems #Robotics and Automated Systems #cs.AI #cs.CL
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
2024/04/22 by Marah Abdin, Abdin, Marah, Jyoti Aneja +262 · 8 voices · 314 citations
Computer Science · #Computational Physics and Python Applications
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
2024/05/07 by DeepSeek-AI, Aixin Liu, Liu, Aixin +310 · 5 voices · 241 citations
Computer Science · #Expert finding and Q&A systems #Topic Modeling #Speech and dialogue systems
- Augmenting Language Models with Long-Term Memory
2023/06/12 by Weizhi Wang, Wang, Weizhi, Li Dong +11 · 3 voices · 22 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
2022/03/07 by Greg Yang, Edward J. Hu, Yang, Greg +17 · 5 voices · 29 citations
Computer Science · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #cond-mat.dis-nn #cs.LG #cs.NE
- DeBERTa: Decoding-enhanced BERT with Disentangled Attention
2020/06/05 by Pengcheng He, Xiaodong Liu, He, Pengcheng +5 · 235 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
2021/10/15 by 裕二 池谷, Robert Tinn, Hao Cheng +6 · 94 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Topic Modeling #Natural Language Processing Techniques #Biomedical Text Mining and Ontologies
- On the Variance of the Adaptive Learning Rate and Beyond
2019/08/08 by Liyuan Liu, Haoming Jiang, Liu, Liyuan +11 · 71 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques
- DeepSeek LLM: Scaling Open-Source Language Models with Longtermism
2024/01/05 by DeepSeek-AI, :, Xiao Guo Bi +170 · 110 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Text Readability and Simplification
- Multi-Task Deep Neural Networks for Natural Language Understanding
2019/01/31 by Xiaodong Liu, Liu, Xiaodong, Pengcheng He +5 · 1 voice · 29 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.CL
- Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing
2019/03/25 by Hao Fu, Fu, Hao, Chunyuan Li +9 · 19 citations
Computer Science · #Algorithms and Data Compression #Machine Learning and Algorithms
- The Illusion of Readiness in Health AI
2025/09/22 by Yu Gu, Yu‐Cheng Gu, Jingjing Fu +64 · 13 voices · 4 citations
Decision Sciences · Computer Science · #Scientific Computing and Data Management #Topic Modeling
- Understanding the Difficulty of Training Transformers
2020/04/17 by Liyuan Liu, Xiaodong Liu, Liu, Liyuan +7 · 14 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Topic Modeling
- AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
2022/10/31 by Yaqing Wang, Sahaj Agarwal, Wang, Yaqing +11 · 12 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing
2021/12/15 by Robert Tinn, Hao Cheng, Tinn, Robert +13 · 7 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- A Hybrid Retrieval-Generation Neural Conversation Model
2019/04/19 by Liu Yang, Yang Liu, Junjie Hu +17 · 1 voice · 2 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.CL #cs.IR
- A 10,000 year record of dune activity, dust storms, and severe drought in the central Great Plains
2007/01/01 by Xiaodong Miao, Joseph A. Mason, James B. Swinehart +4 · 1 voice · 7 citations
Earth and Planetary Sciences · #Aeolian processes and effects #Geology and Paleoclimatology Research #Tree-ring climate responses
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
2023/11/03 by Qingru Zhang, Zhang, Qingru, Chandan Singh +11 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Towards Consistent Natural-Language Explanations via Explanation-Consistency Finetuning
2024/01/25 by Yanda Chen, Chen, Yanda, Chandan Singh +11 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
2019/04/20 by Xiaodong Liu, Pengcheng He, Liu, Xiaodong +5 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Adversarial Training for Large Neural Language Models
2020/04/20 by Xiaodong Liu, Hao Cheng, Liu, Xiaodong +11 · 4 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
2024/11/08 by Tong Chen, Chen, Tong, Hao Fang +13 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques
- Language Models as Inductive Reasoners
2022/12/21 by Zonglin Yang, Yang, Zonglin, Li Dong +13 · 5 citations
Computer Science · #Natural Language Processing Techniques
- Bridging Discrete and Backpropagation: Straight-Through and Beyond
2023/04/17 by Liyuan Liu, Chengyu Dong, Liu, Liyuan +7 · 5 citations
Computer Science · Physics and Astronomy · #Machine Learning and Data Classification #Neural Networks and Applications #Model Reduction and Neural Networks
- Giraffe lineages are shaped by major ancient admixture events
2024/03/12 by Laura D. Bertola, Liam Quinn, Kristian Hanghøj +24 · 1 voice · 6 citations
Biochemistry, Genetics and Molecular Biology · Agricultural and Biological Sciences · #Genetic diversity and population structure #Genomics and Phylogenetic Studies #Plant Taxonomy and Phylogenetics
- R&D Networks: Theory, Empirics, and Policy Implications
2018/07/16 by Michael König, Michael D. König, Xiaodong Liu +2 · 3 citations
Economics, Econometrics and Finance · #Innovation Policy and R&D #Merger and Competition Analysis #Climate Change Policy and Economics
- X-ray lasers 2010 : proceedings of the 12th International Conference on X-ray Lasers, 30 May-4 June 2010, Gwangju, Korea
2011/01/01 by K.K. Mestan, Karen K. Mestan, Jennifer Check +20 · 3 citations
Medicine · #Congenital Diaphragmatic Hernia Studies #Neonatal Respiratory Health Research #Pregnancy and preeclampsia studies #Shoulder and Clavicle Injuries
- HittER: Hierarchical Transformers for Knowledge Graph Embeddings
2020/08/28 by Sanxing Chen, Xiaodong Liu, Chen, Sanxing +9 · 3 citations
Computer Science · Decision Sciences · #Advanced Graph Neural Networks #Computation and Language (cs.CL) #Data Quality and Management #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
- Stochastic Answer Networks for Machine Reading Comprehension
2017/12/10 by Xiaodong Liu, Yelong Shen, Liu, Xiaodong +5 · 5 citations
Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
- Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts
2024/07/12 by Zeliang Zhang, Zhang, Zeliang, Xiaodong Liu +7 · 5 citations
Computer Science · #Data Stream Mining Techniques #Mobile Crowdsensing and Crowdsourcing
- AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
2022/05/24 by Yaqing Wang, Wang, Yaqing, Subhabrata Mukherjee +10 · 2 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Chain-of-Skills: A Configurable Model for Open-domain Question Answering
2023/05/04 by Kaixin Ma, Hao Cheng, Ma, Kaixin +9 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
2024/10/24 by Xiaodong Liu, Sun, Chung-En, Liu, Xiaodong +11 · 4 citations
Computer Science · #Adversarial Robustness in Machine Learning #Computation and Language (cs.CL) #Digital and Cyber Forensics #FOS: Computer and information sciences #Handwritten Text Recognition Techniques #Machine Learning (cs.LG)
- Model Editing for LLMs4Code: How Far are We?
2024/11/11 by Xiaopeng Li, Li, Xiaopeng, Wang, Shangwen +14 · 4 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Model-Driven Software Engineering Techniques #Real-time simulation and control systems #Software Engineering (cs.SE)
- How to Alleviate Catastrophic Forgetting in LLMs Finetuning? Hierarchical Layer-Wise and Element-Wise Regularization
2025/01/23 by Shezheng Song, Hao Xu, Song, Shezheng +13 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Stochastic Answer Networks for SQuAD 2.0
2018/09/24 by Xiaodong Liu, Liu, Xiaodong, Wei Li +9 · 2 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- A Systematic Comparison of Single-Cell Perturbation Response Prediction Models
2024/12/23 by Lanxiang Li, Yue You, Yang-chih Fu +11 · 1 voice · 3 citations
Biochemistry, Genetics and Molecular Biology · Immunology and Microbiology · #Gene Regulatory Network Analysis #Immune cells in cancer #Single-cell and spatial transcriptomics
- Sensitivity of the Australian summer monsoon to tilt and precession forcing
2007/09/17 by Karl-Heinz Wyrwoll, Karl‐Heinz Wyrwoll, Zhengyu Liu +3 · 1 citation
Environmental Science · Earth and Planetary Sciences · #Climate variability and models #Geology and Paleoclimatology Research #Oceanographic and Atmospheric Processes
- Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
2021/04/11 by Simiao Zuo, Zuo, Simiao, Liang Chen +13 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
- Tracking Air Pollution in China: Near Real-Time PM2.5 Retrievals from Multiple Data Sources
2021/03/11 by Guannan Geng, Geng, Guannan, Qingyang Xiao +21 · 1 citation
Earth and Planetary Sciences · Environmental Science · #Air Quality Monitoring and Forecasting #Air Quality and Health Impacts #Atmospheric and Oceanic Physics (physics.ao-ph) #Atmospheric chemistry and aerosols #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG)
- Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization
2021/05/25 by Liang Chen, Simiao Zuo, Liang, Chen +13 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- FlowRL: Matching Reward Distributions for LLM Reasoning
2025/09/18 by Xuekai Zhu, Daixuan Cheng, Zhu, Xuekai +43 · 2 voices · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Reinforcement Learning in Robotics #Topic Modeling #cs.AI #cs.CL #cs.LG
- A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models
2022/02/17 by Da Yin, Dong Li, Yin, Da +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Long-range PM2.5 pollution and health impacts from the 2023 Canadian wildfires
2025/09/10 by Qiang Zhang, Yuexuanzi Wang, Qingyang Xiao +12 · 1 voice · 3 citations
Environmental Science · Earth and Planetary Sciences · #Air Quality and Health Impacts #Atmospheric chemistry and aerosols #Atmospheric and Environmental Gas Dynamics
- Deep Generative Modeling on Limited Data with Regularization by Nontransferable Pre-trained Models
2022/08/30 by Yong Zhong, Hongtao Liu, Zhong, Yong +9 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Music and Audio Processing
- PTSEFormer: Progressive Temporal-Spatial Enhanced TransFormer Towards Video Object Detection
2022/09/06 by Han Wang, Jun Tang, Wang, Han +9 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Efficient Long Sequence Modeling via State Space Augmented Transformer
2022/12/15 by Simiao Zuo, Zuo, Simiao, Xiaodong Liu +11 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- BayLing 2: A Multilingual Large Language Model with Efficient Language Alignment
2024/11/25 by Shaolei Zhang, Zhang, Shaolei, Zhang, Kehao +10 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- SWEA: Updating Factual Knowledge in Large Language Models via Subject Word Embedding Altering
2024/01/31 by Xiaopeng Li, Li, Xiaopeng, Shasha Li +18 · 1 citation
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational and Text Analysis Methods #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- A Pearson’s correlation coefficient based decision tree and its parallel implementation
2017/12/30 by Yashuang Mu, Xiaodong Liu, Lidong Wang · 19 citations
Computer Science · #Data Mining Algorithms and Applications #Rough Sets and Fuzzy Logic #Neural Networks and Applications
- The <i>Silene latifolia</i> genome and its giant Y chromosome
2023/09/22 by Carol Moraga, Catarina Branco, Quentin Rougemont +49 · 1 voice · 1 citation
Agricultural and Biological Sciences · Biochemistry, Genetics and Molecular Biology · #Chromosomal and Genetic Variations #Genetic and Clinical Aspects of Sex Determination and Chromosomal Abnormalities #Plant Reproductive Biology
- Model Tells Itself Where to Attend: Faithfulness Meets Automatic Attention Steering
2024/09/16 by Qingru Zhang, Zhang, Qingru, Xiaodong Yu +15 · 1 citation
Neuroscience · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Mind wandering and attention #Religion, Spirituality, and Psychology
- Map-Free Trajectory Prediction with Map Distillation and Hierarchical Encoding
2024/11/17 by Xiaodong Liu, Liu, Xiaodong, Yucheng Xing +3 · 1 citation
Computer Science · Engineering · #Automated Road and Building Extraction #Computer Vision and Pattern Recognition (cs.CV) #Data Management and Algorithms #FOS: Computer and information sciences #Traffic Prediction and Management Techniques
- Identifying convex obstacles from backscattering far field data
2025/05/17 by Jialei Li, Xiaodong Liu, Li, Jialei +3 · 1 citation
Engineering · Mathematics · Physics and Astronomy · #Electromagnetic Scattering and Analysis #FOS: Mathematics #FOS: Physical sciences #Mathematical Physics (math-ph) #Microwave Imaging and Scattering Analysis #Numerical Analysis (math.NA) #Numerical methods in inverse problems
- Interstellar Object 3I/ATLAS Observed from Mars by China's Tianwen-1 Spacecraft
2026/03/11 by Xin Ren, Wei Yan, Ruining Zhao +20 · 3 voices
#astro-ph.EP #astro-ph.GA
- SkillSight: Calibrating Generic Content Bias for Skill Retrieval
2026/07/21 by Jinying Xiao, Bin Li, Bin Ji +9
Computer Science · #cs.AI
- SMART: LLM-Augmented Hybrid Retrieval for Dynamic Product Ads
2026/07/25 by Congfei Zhang, Jingxiao Ma, Xiaodong Liu +14
#cs.IR #cs.CL #cs.LG
- EGR: Embedding-Native Generative Retrieval with a Shared LLM
2026/07/25 by Xiaodong Liu, Congfei Zhang, Hsiang-wei Chao +13
#cs.IR
- Weak-to-Strong On-Policy Distillation
2026/07/28 by Fangxu Yu, Zinan Lin, Xiaodong Liu +4
Computer Science · #cs.LG
- Scalable LLM Agent Tool Access in the Cloud
2026/07/17 by Mingxin Li, Enge Song, Yueshang Zuo +27
#cs.DC #cs.AI #cs.NI