Yang, Mao
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
2025/01/08 by Xinyu Guan, Guan, Xinyu, Li Lyna Zhang +15 · 11 voices · 65 citations
Computer Science · #Machine Learning and Data Classification #Intelligent Tutoring Systems and Adaptive Learning #Mathematics, Computing, and Information Processing
- LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
2024/02/21 by Yiran Ding, Li Lyna Zhang, Ding, Yiran +13 · 3 voices · 57 citations
Computer Science · #Image Processing and 3D Reconstruction #cs.CL
- SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Search
2021/11/05 by Qi Chen, Chen, Qi, Bing Zhao +13 · 5 voices · 7 citations
#cs.DB #cs.AI #cs.CV #cs.IR #cs.LG
- Tutel: Adaptive Mixture-of-Experts at Scale
2022/06/07 by Chang Ho Hwang, Hwang, Changho, Wei Cui +27 · 26 citations
Computer Science · Medicine · #Advanced Neural Network Applications #COVID-19 diagnosis using AI #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
2023/08/23 by Ranggi Hwang, Hwang, Ranggi, Jianyu Wei +11 · 20 citations
Computer Science · #Topic Modeling #Speech Recognition and Synthesis #Natural Language Processing Techniques
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
2024/10/17 by Yizhao Gao, Zhichen Zeng, Gao, Yizhao +16 · 32 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning and Data Classification #Topic Modeling
- A Neural Corpus Indexer for Document Retrieval
2022/06/06 by Yujing Wang, Wang, Yujing, Yingyan Hou +29 · 13 citations
Computer Science · #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Natural Language Processing Techniques #Text and Document Classification Technologies #Topic Modeling
- Reinforcement Learning with Verifiable Rewards Implicitly Incentivizes Correct Reasoning in Base LLMs
2025/06/17 by Xumeng Wen, Zihan Liu, Wen, Xumeng +20 · 56 citations
Computer Science · #Reinforcement Learning in Robotics
- Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
2024/08/12 by Zhenting Qi, Qi, Zhenting, Mingyuan Ma +9 · 20 citations
Computer Science · #Digital Rights Management and Security
- LUT Tensor Core: A Software-Hardware Co-Design for LUT-Based Low-Bit LLM Inference
2024/08/12 by Zhiwen Mo, Mo, Zhiwen, Lei Wang +19 · 10 citations
Computer Science · #Advanced Data Compression Techniques #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
- rStar-Coder: Scaling Competitive Code Reasoning with a Large-Scale Verified Dataset
2025/05/27 by Yifei Liu, Li Lyna Zhang, Liu, Yifei +13 · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering Research
- IRGen: Generative Modeling for Image Retrieval
2023/03/17 by Zhang, Yidan, Zhang, Ting, Chen, Dong +11 · 5 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
2024/09/25 by Yifei Liu, Liu, Yifei, Jicheng Wen +13 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
2025/06/10 by Shuming Guo, Gao, Yizhao, Guo, Shuming +24 · 10 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
2023/01/26 by Ningxin Zheng, Huiqiang Jiang, Zheng, Ningxin +18 · 4 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Algorithms and Data Compression #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE)
- Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
2023/12/14 by Huang, Xijie, Zhang, Li Lyna, Cheng, Kwang-Ting +2 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- WRENCH: A Comprehensive Benchmark for Weak Supervision
2021/09/23 by Zhang, Jieyu, Yu, Yue, Li, Yinghao +4 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
2025/05/05 by Chen, Yaoqi, Zhang, Jinkai, Lu, Baotong +15 · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- rStar2-Agent: Agentic Reasoning Technical Report
2025/08/28 by Ning Shang, Shang, Ning, Yifei Liu +27 · 19 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multi-Agent Systems and Negotiation
- Accurate and Structured Pruning for Efficient Automatic Speech Recognition
2023/05/31 by Huiqiang Jiang, Jiang, Huiqiang, Li Lyna Zhang +17 · 2 citations
Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Natural Language Processing Techniques
- BitDecoding: Unlocking Tensor Cores for Long-Context LLMs with Low-Bit KV Cache
2025/03/24 by Du, Dayou, Cao, Shijie, Cheng, Jianyi +3 · 6 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Performance (cs.PF)
- LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Accelerator
2025/01/18 by Li, Guoyu, Ye, Shengyu, Chen, Chunyun +6 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
- LongRoPE2: Near-Lossless LLM Context Window Scaling
2025/02/27 by Ning Shang, Shang, Ning, Li Lyna Zhang +12 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Compresso: Structured Pruning with Collaborative Prompting Learns Compact Large Language Models
2023/10/08 by Song Guo, Jiahang Xu, Guo, Song +5 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- TextNAS: A Neural Architecture Search Space tailored for Text Representation
2019/12/23 by Wang, Yujing, Yang, Yaming, Chen, Yiren +7 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE)
- SuperScaler: Supporting Flexible DNN Parallelization via a Unified Abstraction
2023/01/21 by Zhiqi Lin, Lin, Zhiqi, Youshan Miao +23 · 1 citation
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Sensing Assisted Communication for the Next Generation mmWave WLAN: System Simulation Perspective
2023/02/10 by Mao Yang, Zhongjiang Yan, Yang, Mao +10 · 1 citation
Computer Science · Engineering · #Energy Efficient Wireless Sensor Networks #FOS: Computer and information sciences #Indoor and Outdoor Localization Technologies #Networking and Internet Architecture (cs.NI) #Wireless Networks and Protocols
- Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models
2023/05/21 by Yijia Zhang, Lingran Zhao, Zhang, Yijia +15 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Model-enhanced Vector Index
2023/09/23 by Zhang, Hailin, Wang, Yujing, Chen, Qi +16 · 1 citation
#FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training
2025/07/21 by Yang, Kailai, Liu, Xiao, Ji, Lei +4 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RPG: A Repository Planning Graph for Unified and Scalable Codebase Generation
2025/09/19 by Luo, Jane, Xin Zhang, Steven Liu +24 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Software Engineering (cs.SE) #Software Engineering Research #Software Engineering Techniques and Practices #Software Testing and Debugging Techniques
- RedStone: Curating General, Code, Math, and QA Data for Large Language Models
2024/12/04 by Yaoyao Chang, Chang, Yaoyao, Lei Cui +29 · 1 citation
Computer Science · #Natural Language Processing Techniques #Topic Modeling