Shizhe Diao
- Small Language Models are the Future of Agentic AI
2025/06/02 by Peter Belcak, Greg Heinrich, Belcak, Peter +13 · 47 voices · 111 citations
Computer Science · #Multi-Agent Systems and Negotiation #cs.AI
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding
2025/05/28 by Chengyue Wu, Wu, Chengyue, Hao Zhang +15 · 5 voices · 128 citations
Computer Science · Social Sciences · #Topic Modeling #Generative Adversarial Networks and Image Synthesis #Computational and Text Analysis Methods
- SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales
2024/05/31 by Tianyang Xu, Xu, Tianyang, Shujin Wu +11 · 1 voice · 23 citations
Social Sciences · #Artificial Intelligence in Law #Legal Education and Practice Innovations
- RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment
2023/04/13 by Hanze Dong, Dong, Hanze, Wei Xiong +15 · 98 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Speech Recognition and Synthesis #Topic Modeling
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
2024/03/26 by Rui Pan, Pan, Rui, Xiang Liu +11 · 1 voice · 14 citations
Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Speech Recognition and Synthesis #cs.AI #cs.CL #cs.LG #math.OC
- ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models
2025/05/30 by Mingjie Liu, Liu, Mingjie, Shizhe Diao +13 · 2 voices · 69 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- Mitigating the Alignment Tax of RLHF
2023/09/12 by Yong Lin, Hangyu Lin, Lin, Yong +23 · 28 citations
Computer Science · #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Machine Learning (cs.LG)
- UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting
2023/10/15 by Xu Liu, Liu, Xu, Junfeng Hu +11 · 28 citations
Computer Science · Decision Sciences · Engineering · #Energy Load and Power Forecasting #FOS: Computer and information sciences #Machine Learning (cs.LG) #Stock Market Forecasting Methods #Time Series Analysis and Forecasting
- Hymba: A Hybrid-head Architecture for Small Language Models
2024/11/20 by Xin Luna Dong, Xin Dong, Yonggan Fu +25 · 7 voices · 15 citations
Computer Science · #Natural Language Processing Techniques #cs.AI #cs.CL #cs.LG
- ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration
2025/11/26 by Hongjin Su, Shizhe Diao, Su, Hongjin +29 · 4 voices · 4 citations
#cs.CL #cs.AI #cs.LG #cs.MA
- Active Prompting with Chain-of-Thought for Large Language Models
2023/02/23 by Shizhe Diao, Pengcheng Wang, Diao, Shizhe +6 · 16 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Machine Learning and Algorithms
- DetGPT: Detect What You Need via Reasoning
2023/05/23 by Renjie Pi, Pi, Renjie, Jiahui Gao +19 · 1 voice · 8 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #cs.AI #cs.CV
- R-Tuning: Instructing Large Language Models to Say `I Don't Know'
2023/11/16 by Hanning Zhang, Zhang, Hanning, Shizhe Diao +15 · 15 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
2024/10/04 by Haibo Wang, Zhiyang Xu, Wang, Haibo +15 · 20 citations
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Human Pose and Action Recognition
- LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models
2023/06/21 by Shizhe Diao, Diao, Shizhe, Rui Pan +11 · 1 voice · 6 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning and Data Classification #cs.AI #cs.CL
- Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data
2023/02/24 by KaShun Shum, Shum, KaShun, Shizhe Diao +3 · 10 citations
Computer Science · Neuroscience · #Time Series Analysis and Forecasting #EEG and Brain-Computer Interfaces
- MarineGPT: Unlocking Secrets of Ocean to the Public
2023/10/20 by Ziqiang Zheng, Jipeng Zhang, Zheng, Ziqiang +9 · 11 citations
Computer Science · #Topic Modeling #Expert finding and Q&A systems
- Black-box Prompt Learning for Pre-trained Language Models
2022/01/21 by Shizhe Diao, Zhichao Huang, Diao, Shizhe +9 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts
2024/07/03 by Ruida Wang, Jipeng Zhang, Wang, Ruida +11 · 10 citations
Business, Management and Accounting · Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Engineering Technology and Methodologies #FOS: Computer and information sciences #Formal Languages and Automata Theory (cs.FL) #Quality and Management Systems #Semantic Web and Ontologies
- Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories
2023/06/08 by Shizhe Diao, Diao, Shizhe, Tianyang Xu +7 · 5 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations
2019/11/02 by Shizhe Diao, Diao, Shizhe, Jiaxin Bai +7 · 5 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- LongMamba: Enhancing Mamba's Long Context Capabilities via Training-Free Receptive Field Enlargement
2025/04/22 by Zhifan Ye, Kejing Xia, Ye, Zhifan +16 · 8 citations
Computer Science · #Music Technology and Sound Studies
- Write and Paint: Generative Vision-Language Models are Unified Modal Learners
2022/06/15 by Shizhe Diao, Wangchunshu Zhou, Diao, Shizhe +5 · 2 citations
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Generalizable Geometric Image Caption Synthesis
2025/09/18 by Yue Xin, Wenyuan Wang, Xin, Yue +13 · 1 voice · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CV #cs.LG
- Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training
2025/07/16 by Mingjie Liu, Liu, Mingjie, Shizhe Diao +40 · 12 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- PLUM: Improving Code LMs with Execution-Guided On-Policy Preference Learning Driven By Synthetic Test Cases
2024/06/11 by Dylan Zhang, Shizhe Diao, Zhang, Dylan +5 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Programming Languages (cs.PL) #Software Engineering (cs.SE) #Software Testing and Debugging Techniques
- AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?
2026/06/03 by Zhangchen Xu, Junda Chen, Yue Huang +16 · 3 voices
Computer Science · #cs.AI #cs.LG
- Polar: Agentic RL on Any Harness at Scale
2026/05/22 by Binfeng Xu, Hao Zhang, Shaokun Zhang +9 · 1 voice
Computer Science · #cs.DC
- Efficient Neural Network Training via Forward and Backward Propagation\n Sparsification
2021/11/10 by Xiao Zhou, Zhou, Xiao, Weizhong Zhang +7 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- Plum: Prompt Learning using Metaheuristic
2023/11/14 by Rui Pan, Pan, Rui, Shuo Xing +13 · 1 citation
Computer Science · Decision Sciences · #AI-based Problem Solving and Planning #Artificial Intelligence (cs.AI) #Discrete Mathematics (cs.DM) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Scheduling and Timetabling Solutions
- CodeGraph: Enhancing Graph Reasoning of LLMs with Code
2024/08/25 by Q. Cai, Cai, Qiaolong, Zhaowei Wang +7 · 1 citation
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Wikis in Education and Collaboration
- ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT
2022/11/30 by Rui Pan, Pan, Rui, Shizhe Diao +5 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Data Classification #Natural Language Processing Techniques #Optimization and Control (math.OC) #Topic Modeling
- Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training
2025/02/05 by Rui Pan, Pan, Rui, Bo Wang +12 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- From Modalities to Propositions: A Language-Centric Framework for Multimodal Intelligence
2026/07/18 by Nadine Chang, Maying Shen, Shizhe Diao +6
#cs.AI #cs.CV #cs.LG #cs.MM
- Test-Time Coverage: Test-Conditioned Data Curation for Deployment-Aware Learning
2026/07/18 by Nadine Chang, Maying Shen, Shizhe Diao +6
#cs.AI #cs.CV #cs.LG