Stoica, Ion
- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Kwon, Woosuk, Zhuohan Li +15 · 4 voices · 1356 citations
Computer Science · #Caching and Content Delivery #Software System Performance and Reliability #Topic Modeling #cs.DC #cs.LG
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
2023/06/09 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 4 voices · 1233 citations
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
- Ray: A Distributed Framework for Emerging AI Applications
2017/12/16 by Philipp Moritz, Robert Nishihara, Moritz, Philipp +19 · 1 voice · 85 citations
Computer Science · #Cloud Computing and Resource Management #Parallel Computing and Optimization Techniques #Reinforcement Learning in Robotics #cs.AI #cs.DC #cs.LG #stat.ML
- FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
2023/03/13 by Ying Sheng, Lianmin Zheng, Sheng, Ying +25 · 2 voices · 86 citations
Computer Science · Engineering · Materials Science · #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science #Topic Modeling #cs.AI #cs.LG #cs.PF
- LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
2023/09/21 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 6 voices · 82 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- MemGPT: Towards LLMs as Operating Systems
2023/10/12 by Charles Packer, Sarah Wooders, Packer, Charles +11 · 11 voices · 169 citations
#cs.AI
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
2025/04/27 by Lakshya A Agrawal, Agrawal, Lakshya A, Shangyin Tan +33 · 7 voices · 70 citations
Computer Science · #Machine Learning and Data Classification #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #cs.AI #cs.CL #cs.LG #cs.SE
- Why Do Multi-Agent LLM Systems Fail?
2025/03/17 by Cemri, Mert, Pan, Melissa Z., Yang, Shuyi +10 · 9 voices · 117 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- SGLang: Efficient Execution of Structured Language Model Programs
2023/12/12 by Lianmin Zheng, Zheng, Lianmin, Liangsheng Yin +21 · 1 voice · 234 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
- Cloud Programming Simplified: A Berkeley View on Serverless Computing
2019/02/09 by Eric Jonas, Johann Schleier-Smith, Jonas, Eric +25 · 4 voices · 12 citations
Computer Science · #FOS: Computer and information sciences #Operating Systems (cs.OS) #cs.OS
- Measuring Agents in Production
2025/12/02 by Melissa Z. Pan, Pan, Melissa Z., Negar Arabzadeh +47 · 11 voices · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #cs.AI #cs.CY #cs.LG #cs.SE
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
2024/03/12 by Naman Jain, King Han, Jain, Naman +17 · 380 citations
Computer Science · #Software Engineering Research #Model-Driven Software Engineering Techniques
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters
2023/11/06 by Ying Sheng, Shiyi Cao, Sheng, Ying +21 · 2 voices · 20 citations
Computer Science · #Parallel Computing and Optimization Techniques #Topic Modeling #Advanced Neural Network Applications
- Supporting Our AI Overlords: Redesigning Data Systems to be Agent-First
2025/08/31 by Shu Liu, Soujanya Ponnapalli, Liu, Shu +28 · 11 voices · 6 citations
Computer Science · #Big Data and Digital Economy #Semantic Web and Ontologies #Graph Theory and Algorithms
- Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
2024/03/07 by Chiang, Wei-Lin, Zheng, Lianmin, Sheng, Ying +8 · 226 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- RAFT: Adapting Language Model to Domain Specific RAG
2024/03/15 by Tianjun Zhang, Shishir G. Patil, Zhang, Tianjun +11 · 1 voice · 30 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Establishing Best Practices for Building Rigorous Agentic Benchmarks
2025/07/03 by Zhu, Yuxuan, Jin, Tengjun, Pruksachatkun, Yada +22 · 5 voices · 12 citations
#A.1 #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #I.2.m
- NeuroVectorizer: End-to-End Vectorization with Deep Reinforcement\n Learning
2019/09/20 by Ameer Haj-Ali, Nesreen K. Ahmed, Haj-Ali, Ameer +10 · 2 voices · 3 citations
Computer Science · #Advanced Malware Detection Techniques #Cloud Computing and Resource Management #Parallel Computing and Optimization Techniques #cs.DC #cs.PF #cs.PL
- numpywren: serverless linear algebra
2018/10/23 by Vaishaal Shankar, Karl Krauth, Shankar, Vaishaal +14 · 3 voices · 3 citations
Computer Science · #cs.DC
- From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline
2024/06/17 by Tianle Li, Li, Tianle, Wei-Lin Chiang +13 · 90 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RouteLLM: Learning to Route LLMs with Preference Data
2024/06/26 by Isaac Ong, Ong, Isaac, Amjad Almahairi +13 · 85 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies
- Tune: A Research Platform for Distributed Model Selection and Training
2018/07/13 by Richard Liaw, Eric Liang, Liaw, Richard +9 · 34 citations
Computer Science · #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC)
- Ansor: Generating High-Performance Tensor Programs for Deep Learning
2020/06/11 by Lianmin Zheng, Chengfan Jia, Zheng, Lianmin +21 · 37 citations
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Tensor decomposition and applications
- Sleep-time Compute: Beyond Inference Scaling at Test-time
2025/04/17 by Kevin Lin, Charlie Snell, Lin, Kevin +11 · 3 voices · 4 citations
#cs.AI #cs.CL
- Barbarians at the Gate: How AI is Upending Systems Research
2025/10/07 by Audrey Cheng, Cheng, Audrey, Shu Liu +32 · 4 voices · 10 citations
Social Sciences · #Ethics and Social Impacts of AI #cs.AI
- Occupy the Cloud: Distributed Computing for the 99%
2017/02/13 by Eric Jonas, Qifan Pu, Jonas, Eric +7 · 1 voice · 6 citations
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #IoT and Edge/Fog Computing #cs.DC
- Model-Based Value Estimation for Efficient Model-Free Reinforcement Learning
2018/02/28 by Vladimir Feinberg, Alvin Wan, Feinberg, Vladimir +9 · 36 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Traffic control and management #Autonomous Vehicle Technology and Safety
- Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks
2023/02/11 by Daniel Kang, Xuechen Li, Kang, Daniel +9 · 40 citations
Computer Science · #Topic Modeling #Software Engineering Research #Natural Language Processing Techniques
- Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
2024/02/03 by Yichao Fu, Fu, Yichao, Peter Bailis +5 · 51 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Clipper: A Low-Latency Online Prediction Serving System
2016/12/09 by Daniel Crankshaw, Xin Wang, Crankshaw, Daniel +9 · 19 citations
Computer Science · #Data Stream Mining Techniques #Caching and Content Delivery #Cloud Computing and Resource Management
- JudgeBench: A Benchmark for Evaluating LLM-based Judges
2024/10/16 by Tan, Sijun, Siyuan Zhuang, K. Leon Montgomery +11 · 61 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Legal Education and Practice Innovations #Legal Systems and Judicial Processes #Machine Learning (cs.LG)
- Gemmini: Enabling Systematic Deep-Learning Architecture Evaluation via\n Full-Stack Integration
2019/11/22 by Hasan Genç, Seah Kim, Genc, Hasan +35 · 21 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)
- OR-Bench: An Over-Refusal Benchmark for Large Language Models
2024/05/31 by Justin Cui, Wei-Lin Chiang, Cui, Justin +5 · 38 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Learning to Optimize Join Queries With Deep Reinforcement Learning
2018/08/09 by Sanjay Krishnan, Zongheng Yang, Krishnan, Sanjay +8 · 1 voice · 8 citations
Computer Science · #Data Stream Mining Techniques #Databases (cs.DB) #FOS: Computer and information sciences #Metaheuristic Optimization Algorithms Research #Optimization and Search Problems #cs.DB
- The Sky Above The Clouds
2022/05/14 by Sarah Chasins, Alvin Cheung, Chasins, Sarah +32 · 2 voices
Business, Management and Accounting · Engineering · Computer Science · #Digital Platforms and Economics #Green IT and Sustainability #Cloud Computing and Resource Management
- LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!
2025/02/11 by Dacheng Li, Shiyi Cao, Li, Dacheng +21 · 2 voices · 31 citations
Social Sciences · Economics, Econometrics and Finance · #cs.AI
- Rethinking Benchmark and Contamination for Language Models with Rephrased Samples
2023/11/08 by Shuo Yang, Yang, Shuo, Wei-Lin Chiang +7 · 20 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Adversarial Robustness in Machine Learning
- Representing Long-Range Context for Graph Neural Networks with Global Attention
2022/01/21 by Wu, Zhanghao, Jain, Paras, Wright, Matthew A. +3 · 13 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
2025/02/03 by Haocheng Xi, Shuo Yang, Xi, Haocheng +24 · 38 citations
Computer Science · Engineering · #Advanced Optical Imaging Technologies #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
- Multi-Level Discovery of Deep Options
2017/03/24 by Roy Fox, Fox, Roy, Sanjay Krishnan +5 · 14 citations
Computer Science · Decision Sciences · Engineering · #Reinforcement Learning in Robotics #Advanced Bandit Algorithms Research #Reservoir Engineering and Simulation Methods
- GoEX: Perspectives and Designs Towards a Runtime for Autonomous LLM Applications
2024/04/10 by Shishir G. Patil, Patil, Shishir G., Tianjun Zhang +20 · 2 voices · 2 citations
Computer Science · #Distributed and Parallel Computing Systems
- The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks
2025/02/12 by Alejandro Cuadron, Cuadron, Alejandro, Dacheng Li +28 · 36 citations
Social Sciences · #Experimental Behavioral Economics Studies
- Skyplane: Optimizing Transfer Cost and Throughput Using Cloud-Aware Overlays
2022/10/13 by Paras Jain, Sam Kumar, Jain, Paras +9 · 1 voice · 3 citations
Computer Science · #Cloud Computing and Resource Management #Peer-to-Peer Network Technologies #Caching and Content Delivery
- Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems
2024/03/04 by Lingjiao Chen, Chen, Lingjiao, Jared Quincy Davis +11 · 17 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Law, AI, and Intellectual Property #Machine Learning (cs.LG) #Systems and Control (eess.SY) #electronic engineering #information engineering
- GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
2025/05/29 by Manish Shetty, Shetty, Manish, Naman Jain +9 · 2 voices · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #cs.AI #cs.CL #cs.LG #cs.SE
- Specifications: The missing link to making the development of LLM systems an engineering discipline
2024/11/25 by Ion Stoica, Matei Zaharia, Stoica, Ion +22 · 2 voices · 5 citations
Decision Sciences · Engineering · Mathematics · #Manufacturing Process and Optimization #Modeling, Simulation, and Optimization #Simulation Techniques and Applications #cs.AI #cs.CL #cs.SE
- Online Speculative Decoding
2023/10/11 by Xiaoxuan Liu, Liu, Xiaoxuan, Lanxiang Hu +11 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- FetchSGD: Communication-Efficient Federated Learning with Sketching
2020/07/15 by Daniel Rothchild, Ashwinee Panda, Rothchild, Daniel +13 · 8 citations
Computer Science · #Privacy-Preserving Technologies in Data #Mobile Crowdsensing and Crowdsourcing #Stochastic Gradient Optimization Techniques
- How to Evaluate Reward Models for RLHF
2024/10/18 by Evan Frick, Tianle Li, Frick, Evan +15 · 20 citations
Decision Sciences · #Risk and Safety Analysis
- Fast Video Generation with Sliding Tile Attention
2025/02/06 by Yongqi Chen, Zhang, Peiyuan, Runlong Su +8 · 26 citations
Computer Science · Engineering · #Advanced Optical Imaging Technologies #Advanced Vision and Imaging #Cellular Automata and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Checkmate: Breaking the Memory Wall with Optimal Tensor Rematerialization
2019/10/07 by Paras Jain, Jain, Paras, Ajay N. Jain +13 · 8 citations
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
- Accelerating Quadratic Optimization with Reinforcement Learning
2021/07/22 by Ichnowski, Jeffrey, Jain, Paras, Stellato, Bartolomeo +6 · 8 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents
2025/04/09 by Jain, Naman, Singh, Jaskirat, Shetty, Manish +3 · 28 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE)
- RLlib: Abstractions for Distributed Reinforcement Learning
2017/12/26 by Eric Liang, Richard Liaw, Liang, Eric +15 · 1 voice · 2 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Parallel #Reinforcement Learning in Robotics #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG
- Ekya: Continuous Learning of Video Analytics Models on Edge Compute\n Servers
2020/12/18 by Romil Bhardwaj, Zhengxu Xia, Bhardwaj, Romil +15 · 7 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Image Enhancement Techniques #Parallel #and Cluster Computing (cs.DC)
- MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
2024/11/18 by Shiyi Cao, Cao, Shiyi, Shu Liu +15 · 17 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Blink: Fast and Generic Collectives for Distributed ML
2019/10/11 by Guanhua Wang, Wang, Guanhua, Shivaram Venkataraman +9 · 8 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- AutoPhase: Juggling HLS Phase Orderings in Random Forests with Deep Reinforcement Learning
2020/03/02 by Huang, Qijing, Haj-Ali, Ameer, Moses, William +4 · 6 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
- S*: Test Time Scaling for Code Generation
2025/02/20 by Li, Dacheng, Cao, Shiyi, Cao, Chengkun +6 · 23 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning
2022/01/28 by Zheng, Lianmin, Li, Zhuohan, Zhang, Hao +9 · 7 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
- BlinkDB: Queries with Bounded Errors and Bounded Response Times on Very Large Data
2012/03/25 by Sameer Agarwal, Agarwal, Sameer, Aurojit Panda +7 · 4 citations
Computer Science · #Data Management and Algorithms #Advanced Database Systems and Queries #Cloud Computing and Resource Management
- DistCache: Provable Load Balancing for Large-Scale Storage Systems with Distributed Caching
2019/01/23 by Zaoxing Liu, Zhihao Bai, Liu, Zaoxing +13 · 5 citations
Computer Science · #Caching and Content Delivery #Advanced Data Storage Technologies #Cloud Computing and Resource Management
- WorldModelBench: Judging Video Generation Models As World Models
2025/02/28 by Li, Dacheng, Fang, Yunhao, Chen, Yukang +10 · 19 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Efficient LLM Scheduling by Learning to Rank
2024/08/28 by Yichao Fu, Siqi Zhu, Fu, Yichao +9 · 12 citations
Computer Science · #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving
2024/04/02 by Jiangfei Duan, Runyu Lu, Duan, Jiangfei +13 · 10 citations
Engineering · #Power Line Communications and Noise
- SparkNet: Training Deep Networks in Spark
2015/11/19 by Philipp Moritz, Robert Nishihara, Moritz, Philipp +5 · 1 voice · 1 citation
Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG #cs.NE #math.OC #stat.ML
- VSA: Faster Video Diffusion with Trainable Sparse Attention
2025/05/19 by Zhang, Peiyuan, Chen, Yongqi, Huang, Haofeng +5 · 25 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- NetChain: Scale-Free Sub-RTT Coordination (Extended Version)
2018/02/22 by Xin Jin, Xiaozhou Li, Jin, Xin +13 · 2 voices
#cs.DC
- NeuroCard: One Cardinality Estimator for All Tables
2020/06/15 by Zongheng Yang, Yang, Zongheng, Amog Kamsetty +11 · 7 citations
Computer Science · #Advanced Database Systems and Queries #Data Management and Algorithms #Data Visualization and Analytics #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
2023/02/22 by Zhuohan Li, Lianmin Zheng, Li, Zhuohan +19 · 7 citations
Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
2021/04/29 by Jianfei Chen, Chen, Jianfei, Lianmin Zheng +11 · 5 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Scaling up Trustless DNN Inference with Zero-Knowledge Proofs
2022/10/17 by Daniel Kang, Kang, Daniel, Tatsunori Hashimoto +5 · 6 citations
Medicine · Computer Science · #COVID-19 diagnosis using AI #Medical Imaging Techniques and Applications #Advanced Neural Network Applications
- Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules
2019/05/14 by Ho, Daniel, Liang, Eric, Stoica, Ion +2 · 4 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Highly Available Transactions: Virtues and Limitations (Extended Version)
2013/02/01 by Bailis, Peter, Davidson, Aaron, Fekete, Alan +3 · 3 citations
#Databases (cs.DB) #FOS: Computer and information sciences
- SuperServe: Fine-Grained Inference Serving for Unpredictable Workloads
2023/12/27 by Alind Khare, Dhruv Garg, Khare, Alind +9 · 7 citations
Computer Science · #Advanced Data Storage Technologies #Parallel Computing and Optimization Techniques #Caching and Content Delivery
- DISTFLASHATTN: Distributed Memory-efficient Attention for Long-context LLMs Training
2023/10/05 by Li, Dacheng, Shao, Rulin, Xie, Anze +5 · 7 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- RLlib Flow: Distributed Reinforcement Learning is a Dataflow Problem
2020/11/25 by Liang, Eric, Wu, Zhanghao, Luo, Michael +3 · 4 citations
#C.4 #Distributed #FOS: Computer and information sciences #I.2.11 #I.2.6 #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation
2025/05/24 by Yang, Shuo, Xi, Haocheng, Zhao, Yilong +11 · 20 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models
2021/02/16 by Li, Zhuohan, Zhuang, Siyuan, Guo, Shiyuan +4 · 4 citations
#Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Fairness in Serving Large Language Models
2023/12/31 by Ying Sheng, Sheng, Ying, Shiyi Cao +13 · 6 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Performance (cs.PF)
- Autellix: An Efficient Serving Engine for LLM Agents as General Programs
2025/02/19 by Michael Luo, Luo, Michael, Shi, Xiaoxiang +17 · 11 citations
Computer Science · Engineering · #Mobile Agent-Based Network Management #Modular Robots and Swarm Intelligence #Advanced Manufacturing and Logistics Optimization
- Post-Training Sparse Attention with Double Sparsity
2024/08/11 by Shuo Yang, Ying Sheng, Yang, Shuo +7 · 9 citations
Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG)
- AutoPhase: Compiler Phase-Ordering for High Level Synthesis with Deep Reinforcement Learning
2019/01/15 by Ameer Haj-Ali, Haj-Ali, Ameer, Qijing Huang +11 · 3 citations
Computer Science · #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #Software Engineering Research
- Faster and More Accurate Sequence Alignment with SNAP
2011/11/23 by Zaharia, Matei, Bolosky, William J., Curtis, Kristal +6 · 2 citations
#Data Structures and Algorithms (cs.DS) #FOS: Biological sciences #FOS: Computer and information sciences #Genomics (q-bio.GN)
- PrefillOnly: An Inference Engine for Prefill-only Workloads in Large Language Model Applications
2025/05/12 by Kuntai Du, Bowen Wang, Du, Kuntai +19 · 12 citations
Computer Science · Materials Science · #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference
2024/11/02 by Jiang, Xuanlin, Zhou, Yang, Cao, Shiyi +2 · 8 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Scaling Replicated State Machines with Compartmentalization [Technical Report]
2020/12/31 by Whittaker, Michael, Ailijiang, Ailidani, Charapko, Aleksey +6 · 3 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation
2025/06/24 by Li, Xingyang, Li, Muyang, Cai, Tianle +11 · 17 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Models
2025/06/21 by Kwok, Jacky, Agia, Christopher, Sinha, Rohan +5 · 13 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Electrical engineering #Robotics (cs.RO) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Twilight: Adaptive Attention Sparsity with Hierarchical Top-p Pruning
2025/02/04 by Lin, Chaofan, Shuo Yang, Tang, Jiaming +13 · 7 citations
Computer Science · Decision Sciences · #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics #Advanced Bandit Algorithms Research
- POET: Training Neural Networks on Tiny Devices with Integrated Rematerialization and Paging
2022/07/15 by Patil, Shishir G., Jain, Paras, Dutta, Prabal +2 · 3 citations
#Computer Vision and Pattern Recognition (cs.CV) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
- Prism: Cost-Efficient Multi-LLM Serving via GPU Memory Ballooning
2025/05/06 by Shan Yu, Yifan Qiao, Yu, Shan +29 · 12 citations
Computer Science · #Parallel Computing and Optimization Techniques #Big Data and Digital Economy #Natural Language Processing Techniques
- LLM-Assisted Code Cleaning For Training Accurate Code Generators
2023/11/25 by Jain, Naman, Zhang, Tianjun, Chiang, Wei-Lin +3 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE)
- Optimizing LLM Queries in Relational Data Analytics Workloads
2024/03/09 by Shuming Liu, A. Biswal, Liu, Shu +16 · 5 citations
Computer Science · #Advanced Database Systems and Queries #Data Mining Algorithms and Applications #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
- Prompt-to-Leaderboard
2025/02/20 by Frick, Evan, Chen, Connor, Tennyson, Joseph +4 · 9 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Communication-efficient distributed SGD with Sketching
2019/03/12 by Ivkin, Nikita, Rothchild, Daniel, Ullah, Enayat +3 · 2 citations
#Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- Optimizing Model Selection for Compound AI Systems
2025/02/20 by Chen, Lingjiao, Davis, Jared Quincy, Hanin, Boris +4 · 8 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA)
- Stylus: Automatic Adapter Selection for Diffusion Models
2024/04/29 by Luo, Michael, Wong, Justin, Trabucco, Brandon +5 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG)
- lmgame-Bench: How Good are LLMs at Playing Games?
2025/05/21 by Hu, Lanxiang, Huo, Mingjia, Zhang, Yuxuan +6 · 8 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- GameArena: Evaluating LLM Reasoning through Live Computer Games
2024/12/09 by Lanxiang Hu, Qiyu Li, Hu, Lanxiang +8 · 6 citations
Computer Science · Social Sciences · #Multi-Agent Systems and Negotiation #Artificial Intelligence in Law #Software Engineering Research
- Resource Allocation in Multi-armed Bandit Exploration: Overcoming Sublinear Scaling with Adaptive Parallelism
2020/10/31 by Thananjeyan, Brijen, Kandasamy, Kirthevasan, Stoica, Ion +3 · 2 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #and Cluster Computing (cs.DC)
- Efficiently Scaling LLM Reasoning with Certaindex
2024/12/30 by Yichao Fu, Fu, Yichao, Junda Chen +11 · 7 citations
Computer Science · #Computation and Language (cs.CL) #Digital Rights Management and Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies
- TurboSpec: Closed-loop Speculation Control System for Optimizing LLM Serving Goodput
2024/06/20 by Xiaoxuan Liu, Liu, Xiaoxuan, Park, Jongseok +19 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Performance (cs.PF) #Topic Modeling
- Read-Write Quorum Systems Made Practical
2021/04/08 by Whittaker, Michael, Charapko, Aleksey, Hellerstein, Joseph M. +2 · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Neural Packet Classification
2019/02/27 by Eric Liang, Liang, Eric, Hang Zhu +5 · 2 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization #Network Security and Intrusion Detection #Networking and Internet Architecture (cs.NI) #Protein Degradation and Inhibitors
- VCG Mechanism Design with Unknown Agent Values under Stochastic Bandit Feedback
2020/04/19 by Kandasamy, Kirthevasan, Gonzalez, Joseph E., Jordan, Michael I. +1 · 2 citations
#Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- MPC-Minimized Secure LLM Inference
2024/08/07 by Deevashwer Rathee, Dacheng Li, Rathee, Deevashwer +7 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Interconnection Networks and Systems #Machine Learning (cs.LG)
- FogROS2: An Adaptive Platform for Cloud and Fog Robotics Using ROS 2
2022/05/19 by Jeffrey Ichnowski, Kaiyuan Chen, Ichnowski, Jeffrey +27 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Modular Robots and Swarm Intelligence #Robotics (cs.RO) #Robotics and Automated Systems
- Advancing Science- and Evidence-based AI Policy
2025/07/31 by Rishi Bommasani, Sanjeev Arora, Bommasani, Rishi +37 · 1 voice · 6 citations
Medicine · Computer Science · #Computers and Society (cs.CY) #FOS: Computer and information sciences
- BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
2024/11/25 by Yilong Zhao, Shuo Yang, Zhao, Yilong +13 · 6 citations
Computer Science · #AI in cancer detection #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Trustless Audits without Revealing Data or Models
2024/04/06 by Suppakit Waiwitlikhit, Waiwitlikhit, Suppakit, Ion Stoica +7 · 3 citations
Computer Science · #Blockchain Technology Applications and Security
- ZK-IMG: Attested Images via Zero-Knowledge Proofs to Fight Disinformation
2022/11/09 by Kang, Daniel, Hashimoto, Tatsunori, Stoica, Ion +1 · 2 citations
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences
- On Optimizing the Communication of Model Parallelism
2022/11/10 by Zhuang, Yonghao, Zhao, Hexu, Zheng, Lianmin +6 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- VisionArena: 230K Real World User-VLM Conversations with Preference Labels
2024/12/11 by Christopher Chou, Lisa Dunlap, Chou, Christopher +12 · 4 citations
Environmental Science · #Impact of Light on Environment and Health
- Mélange: Cost Efficient Large Language Model Serving by Exploiting GPU Heterogeneity
2024/04/22 by Griggs, Tyler, Liu, Xiaoxuan, Yu, Jiaxiang +4 · 3 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Shark: SQL and Rich Analytics at Scale
2012/11/27 by Xin, Reynold, Rosen, Josh, Zaharia, Matei +3 · 1 citation
#Databases (cs.DB) #FOS: Computer and information sciences
- Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Design
2024/07/23 by Davis, Jared Quincy, Hanin, Boris, Chen, Lingjiao +3 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- Locality-aware Fair Scheduling in LLM Serving
2025/01/24 by Shiyi Cao, Cao, Shiyi, Yichuan Wang +22 · 4 citations
Computer Science · Engineering · #Advanced Manufacturing and Logistics Optimization #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Petri Nets in System Modeling #Scheduling and Optimization Algorithms #and Cluster Computing (cs.DC)
- Pie: Pooling CPU Memory for LLM Inference
2024/11/14 by Yi Xu, Xu, Yi, Ziming Mao +7 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- HashAttention: Semantic Sparsity for Faster Inference
2024/12/19 by Aditya Desai, Shuo Yang, Desai, Aditya +9 · 5 citations
Computer Science · Medicine · #Cryptography and Data Security #Big Data and Digital Economy #COVID-19 diagnosis using AI
- BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation
2025/02/03 by Alan Zhu, Parth Asawa, Zhu, Alan +12 · 4 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- An Extensible Software Transport Layer for GPU Networking
2025/04/24 by Yang Zhou, Zhongjie Chen, Zhou, Yang +25 · 6 citations
Computer Science · #Cloud Computing and Resource Management #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI)
- Copilot Arena: A Platform for Code LLM Evaluation in the Wild
2025/02/13 by Wayne Chi, Chi, Wayne, Valerie Chen +16 · 5 citations
Computer Science · #Digital and Cyber Forensics #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering (cs.SE)
- Lazarus: Resilient and Elastic Training of Mixture-of-Experts Models
2024/07/05 by Yongji Wu, Wenjie Qu, Wu, Yongji +19 · 3 citations
Computer Science · Engineering · #Gaussian Processes and Bayesian Inference #Target Tracking and Data Fusion in Sensor Networks #Reservoir Engineering and Simulation Methods
- InferLine: ML Prediction Pipeline Provisioning and Management for Tight Latency Objectives
2018/12/05 by Daniel Crankshaw, Crankshaw, Daniel, Gur-Eyal Sela +11 · 1 citation
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning and Data Classification #Parallel #Software Testing and Debugging Techniques #Web Data Mining and Analysis #and Cluster Computing (cs.DC)
- Dynamic Space-Time Scheduling for GPU Inference
2018/12/31 by Jain, Paras, Mo, Xiangxi, Jain, Ajay +5 · 1 citation
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Harmonia: Near-Linear Scalability for Replicated Storage with In-Network Conflict Detection
2019/04/18 by Hang Zhu, Zhu, Hang, Zhihao Bai +11 · 1 citation
Computer Science · #Advanced Data Storage Technologies #Caching and Content Delivery #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Real-Time Machine Learning: The Missing Pieces
2017/03/11 by Robert Nishihara, Philipp Moritz, Nishihara, Robert +17 · 1 voice · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG
- Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboards
2025/01/13 by Huang, Yangsibo, Nasr, Milad, Angelopoulos, Anastasios +10 · 3 citations
#Cryptography and Security (cs.CR) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Hierarchical Variational Imitation Learning of Control Programs
2019/12/29 by Roy Fox, Fox, Roy, Richard Shin +13 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Reinforcement Learning in Robotics #Robot Manipulation and Learning
- Jenga: Effective Memory Management for Serving LLM with Heterogeneity
2025/03/24 by Zhang, Chen, Du, Kuntai, Liu, Shu +10 · 3 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile
2025/02/10 by Hangliang Ding, Ding, Hangliang, Dacheng Li +9 · 4 citations
Engineering · Computer Science · #Advanced Memory and Neural Computing #Advanced Optical Imaging Technologies #Neural Networks and Reservoir Computing
- TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Times
2025/12/18 by Jintao Zhang, Zhang, Jintao, Kaiwen Zheng +13 · 1 voice · 1 citation
#cs.CV #cs.AI #cs.LG
- SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
2025/09/28 by Zhang, Jintao, Wang, Haoxu, Jiang, Kai +10 · 6 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- SkyWalker: A Locality-Aware Cross-Region Load Balancer for LLM Inference
2025/05/30 by Xia, Tian, Mao, Ziming, Kerney, Jamison +5 · 5 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Hoplite: Efficient and Fault-Tolerant Collective Communication for Task-Based Distributed Systems
2020/02/13 by Siyuan Zhuang, Zhuang, Siyuan, Zhuohan Li +13 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Composing MPC with LQR and Neural Network for Amortized Efficiency and Stable Control
2021/12/14 by Fangyu Wu, Guanhua Wang, Wu, Fangyu +11 · 1 citation
Engineering · #Advanced Control Systems Optimization #Control Systems and Identification #FOS: Electrical engineering #Fuel Cells and Related Materials #Systems and Control (eess.SY) #electronic engineering #information engineering
- Grounded Graph Decoding Improves Compositional Generalization in Question Answering
2021/11/05 by Yu Gai, Gai, Yu, Paras Jain +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- ProTuner: Tuning Programs with Monte Carlo Tree Search
2020/05/27 by Ameer Haj-Ali, Hasan Genc, Haj-Ali, Ameer +11 · 1 voice
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #Programming Languages (cs.PL) #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG #cs.PF #cs.PL
- Context-Aware Streaming Perception in Dynamic Environments
2022/08/16 by Sela, Gur-Eyal, Gog, Ionel, Wong, Justin +9 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Leveraging Cloud Computing to Make Autonomous Vehicles Safer
2023/08/06 by Peter Schafhalter, Sukrit Kalra, Schafhalter, Peter +7 · 1 citation
Computer Science · Engineering · #Advanced Neural Network Applications #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Robotics (cs.RO) #Vehicular Ad Hoc Networks (VANETs)
- DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesis
2025/08/27 by Patel, Liana, Arabzadeh, Negar, Gupta, Harshit +4 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- CodeScholar: Growing Idiomatic Code Examples
2023/12/23 by Shetty, Manish, Sen, Koushik, Stoica, Ion · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Programming Languages (cs.PL) #Software Engineering (cs.SE)
- Continuum: Efficient and Robust Multi-Turn LLM Agent Scheduling with KV Cache Time-to-Live
2025/11/04 by Li, Hanchen, Mang, Qiuyang, He, Runyuan +7 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI) #Operating Systems (cs.OS)
- A Statistical Framework for Ranking LLM-Based Chatbots
2024/12/24 by Siavash Ameli, Ameli, Siavash, Siyuan Zhuang +5 · 1 voice · 1 citation
Computer Science · #AI in Service Interactions #cs.AI #cs.LG #stat.ML
- Crafting Interpretable Embeddings by Asking LLMs Questions
2024/05/26 by Benara, Vinamra, Singh, Chandan, Morris, John X. +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neurons and Cognition (q-bio.NC)
- HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
2025/04/04 by Yang Wu, Wu, Yongji, Xueshen Liu +15 · 2 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Big Data and Digital Economy
- Bipartisan Paxos: A Modular State Machine Replication Protocol
2020/02/29 by Michael Whittaker, Neil Giridharan, Whittaker, Michael +7 · 1 citation
Computer Science · #Advanced Data Storage Technologies #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agent
2025/11/20 by Cao, Shiyi, Li, Dacheng, Zhao, Fangzhou +12 · 3 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- vCache: Verified Semantic Prompt Caching
2025/02/06 by Luis Gaspar Schroeder, Schroeder, Luis Gaspar, Aditya Desai +18 · 1 citation
Computer Science · #Caching and Content Delivery #Service-Oriented Architecture and Web Services #Cognitive Computing and Networks
- vAttention: Verified Sparse Attention
2025/10/07 by Aditya Desai, Desai, Aditya, Kumar Krishna Agrawal +13 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient Long-context Language Model Training by Core Attention Disaggregation
2025/10/20 by Yonghao Zhuang, Zhuang, Yonghao, Bo Pang +14 · 1 citation
Computer Science · #Big Data and Digital Economy #Advanced Neural Network Applications #Natural Language Processing Techniques
- The Streaming Batch Model for Efficient and Fault-Tolerant Heterogeneous Execution
2025/01/16 by Frank Sifei Luan, Luan, Frank Sifei, Wang, Ron Yifeng +24 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #Distributed systems and fault tolerance #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
2025/12/01 by Yilong Zhao, Zhao, Yilong, Jiaming Tang +21 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations
2025/12/16 by Mayank Mishra, Guo, Wentao, Xinle Cheng +6 · 1 citation
Computer Science · #Topic Modeling #Mobile Crowdsensing and Crowdsourcing #Advanced Neural Network Applications