Ion Stoica
- Efficient Memory Management for Large Language Model Serving with PagedAttention
2023/09/12 by Woosuk Kwon, Zhuohan Li, Kwon, Woosuk +15 · 4 voices · 1730 citations
Computer Science · #Caching and Content Delivery #Software System Performance and Reliability #Topic Modeling #cs.DC #cs.LG
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
2023/06/09 by Lianmin Zheng, Zheng, Lianmin, Wei-Lin Chiang +24 · 4 voices · 1632 citations
Computer Science · #AI in Service Interactions #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
- Ray: A Distributed Framework for Emerging AI Applications
2017/12/16 by Philipp Moritz, Robert Nishihara, Moritz, Philipp +19 · 1 voice · 111 citations
Computer Science · #Cloud Computing and Resource Management #Parallel Computing and Optimization Techniques #Reinforcement Learning in Robotics #cs.AI #cs.DC #cs.LG #stat.ML
- FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
2023/03/13 by Ying Sheng, Lianmin Zheng, Sheng, Ying +25 · 2 voices · 110 citations
Computer Science · Engineering · Materials Science · #Ferroelectric and Negative Capacitance Devices #Machine Learning in Materials Science #Topic Modeling #cs.AI #cs.LG #cs.PF
- LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
2023/09/21 by Lianmin Zheng, Wei-Lin Chiang, Zheng, Lianmin +24 · 6 voices · 111 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- MemGPT: Towards LLMs as Operating Systems
2023/10/12 by Charles Packer, Packer, Charles, Sarah Wooders +11 · 11 voices · 201 citations
Computer Science · Decision Sciences · #Context-Aware Activity Recognition Systems #Scientific Computing and Data Management #Topic Modeling #cs.AI
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
2024/03/12 by Naman Jain, Jain, Naman, King Han +17 · 1 voice · 519 citations
Computer Science · #Model-Driven Software Engineering Techniques #Software Engineering Research #cs.CL #cs.LG #cs.SE
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
2025/04/27 by Lakshya A Agrawal, Shangyin Tan, Agrawal, Lakshya A +33 · 7 voices · 71 citations
Computer Science · #Machine Learning and Data Classification #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #cs.AI #cs.CL #cs.LG #cs.SE
- SGLang: Efficient Execution of Structured Language Model Programs
2023/12/12 by Lianmin Zheng, Liangsheng Yin, Zheng, Lianmin +21 · 1 voice · 290 citations
Computer Science · #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling #cs.AI #cs.PL
- Cloud Programming Simplified: A Berkeley View on Serverless Computing
2019/02/09 by Eric Jonas, Jonas, Eric, Johann Schleier-Smith +25 · 4 voices · 16 citations
Computer Science · #FOS: Computer and information sciences #Operating Systems (cs.OS) #cs.OS
- S-LoRA: Serving Thousands of Concurrent LoRA Adapters
2023/11/06 by Ying Sheng, Sheng, Ying, Shiyi Cao +21 · 2 voices · 29 citations
Computer Science · #Parallel Computing and Optimization Techniques #Topic Modeling #Advanced Neural Network Applications
- Measuring Agents in Production
2025/12/02 by Melissa Z. Pan, Negar Arabzadeh, Pan, Melissa Z. +47 · 11 voices · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #cs.AI #cs.CY #cs.LG #cs.SE
- Supporting Our AI Overlords: Redesigning Data Systems to be Agent-First
2025/08/31 by Shu Liu, Liu, Shu, Soujanya Ponnapalli +28 · 11 voices · 8 citations
Computer Science · #Big Data and Digital Economy #Semantic Web and Ontologies #Graph Theory and Algorithms
- numpywren: serverless linear algebra
2018/10/23 by Vaishaal Shankar, Shankar, Vaishaal, Karl Krauth +14 · 3 voices · 7 citations
Computer Science · #cs.DC
- RAFT: Adapting Language Model to Domain Specific RAG
2024/03/15 by Tianjun Zhang, Zhang, Tianjun, Shishir G. Patil +11 · 1 voice · 48 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Tune: A Research Platform for Distributed Model Selection and Training
2018/07/13 by Richard Liaw, Eric Liang, Liaw, Richard +9 · 61 citations
Computer Science · #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC)
- NeuroVectorizer: End-to-End Vectorization with Deep Reinforcement\n Learning
2019/09/20 by Ameer Haj-Ali, Nesreen K. Ahmed, Haj-Ali, Ameer +10 · 2 voices · 4 citations
Computer Science · #Advanced Malware Detection Techniques #Cloud Computing and Resource Management #Parallel Computing and Optimization Techniques #cs.DC #cs.PF #cs.PL
- From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline
2024/06/17 by Tianle Li, Li, Tianle, Wei-Lin Chiang +13 · 122 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- RouteLLM: Learning to Route LLMs with Preference Data
2024/06/26 by Isaac Ong, Amjad Almahairi, Ong, Isaac +13 · 111 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Semantic Web and Ontologies
- Sleep-time Compute: Beyond Inference Scaling at Test-time
2025/04/17 by Kevin Lin, Lin, Kevin, Charlie Snell +11 · 3 voices · 8 citations
Computer Science · #Big Data and Digital Economy #Multimodal Machine Learning Applications #Topic Modeling #cs.AI #cs.CL
- Occupy the Cloud: Distributed Computing for the 99%
2017/02/13 by Eric Jonas, Jonas, Eric, Qifan Pu +7 · 1 voice · 12 citations
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #IoT and Edge/Fog Computing #cs.DC
- Ansor: Generating High-Performance Tensor Programs for Deep Learning
2020/06/11 by Lianmin Zheng, Chengfan Jia, Zheng, Lianmin +21 · 50 citations
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Tensor decomposition and applications
- LLM-as-a-Verifier: A General-Purpose Verification Framework
2026/07/06 by Jacky Kwok, Shulu Li, Pranav Atreya +6 · 6 voices
#cs.AI #cs.CL #cs.LG #cs.MA #cs.RO
- The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks
2025/02/12 by Alejandro Cuadron, Dacheng Li, Cuadron, Alejandro +30 · 2 voices · 53 citations
Computer Science · Social Sciences · #Experimental Behavioral Economics Studies #cs.AI
- Model-Based Value Estimation for Efficient Model-Free Reinforcement Learning
2018/02/28 by Vladimir Feinberg, Feinberg, Vladimir, Alvin Wan +9 · 48 citations
Computer Science · Engineering · #Reinforcement Learning in Robotics #Traffic control and management #Autonomous Vehicle Technology and Safety
- Clipper: A Low-Latency Online Prediction Serving System
2016/12/09 by Daniel Crankshaw, Xin Wang, Crankshaw, Daniel +9 · 28 citations
Computer Science · #Data Stream Mining Techniques #Caching and Content Delivery #Cloud Computing and Resource Management
- Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks
2023/02/11 by Daniel Kang, Kang, Daniel, Xuechen Li +9 · 47 citations
Computer Science · #Topic Modeling #Software Engineering Research #Natural Language Processing Techniques
- Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
2024/02/03 by Yichao Fu, Fu, Yichao, Peter Bailis +5 · 60 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Gemmini: Enabling Systematic Deep-Learning Architecture Evaluation via\n Full-Stack Integration
2019/11/22 by Hasan Genç, Genc, Hasan, Seah Kim +35 · 30 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC)
- Barbarians at the Gate: How AI is Upending Systems Research
2025/10/07 by Audrey Cheng, Shu Liu, Cheng, Audrey +32 · 4 voices · 10 citations
Social Sciences · #Ethics and Social Impacts of AI #cs.AI
- JudgeBench: A Benchmark for Evaluating LLM-based Judges
2024/10/16 by Tan, Sijun, Siyuan Zhuang, Zhuang, Siyuan +11 · 76 citations
Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Legal Education and Practice Innovations #Legal Systems and Judicial Processes #Machine Learning (cs.LG)
- Chord: a scalable peer-to-peer lookup protocol for internet applications
2003/02/01 by I. Stoica, Ion Stoica, Robert Morris +11 · 18 citations
Computer Science · #Caching and Content Delivery #Cooperative Communication and Network Coding #Peer-to-Peer Network Technologies
- Learning to Optimize Join Queries With Deep Reinforcement Learning
2018/08/09 by Sanjay Krishnan, Krishnan, Sanjay, Zongheng Yang +8 · 1 voice · 14 citations
Computer Science · #Data Stream Mining Techniques #Databases (cs.DB) #FOS: Computer and information sciences #Metaheuristic Optimization Algorithms Research #Optimization and Search Problems #cs.DB
- OR-Bench: An Over-Refusal Benchmark for Large Language Models
2024/05/31 by Justin Cui, Cui, Justin, Wei-Lin Chiang +5 · 50 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Representing Long-Range Context for Graph Neural Networks with Global Attention
2022/01/21 by Zhanghao Wu, Paras Jain, Wu, Zhanghao +9 · 24 citations
Computer Science · Materials Science · #Advanced Graph Neural Networks #FOS: Computer and information sciences #Graph Theory and Algorithms #Machine Learning (cs.LG) #Machine Learning in Materials Science
- LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!
2025/02/11 by Dacheng Li, Li, Dacheng, Shiyi Cao +21 · 2 voices · 52 citations
Social Sciences · Economics, Econometrics and Finance · #cs.AI
- GoEX: Perspectives and Designs Towards a Runtime for Autonomous LLM Applications
2024/04/10 by Shishir G. Patil, Patil, Shishir G., Tianjun Zhang +20 · 2 voices · 4 citations
Computer Science · #Distributed and Parallel Computing Systems
- Flash-KMeans: Fast and Memory-Efficient Exact K-Means
2026/03/10 by Shuo Yang, Haocheng Xi, Yilong Zhao +10 · 7 voices · 1 citation
#cs.DC
- Multi-Level Discovery of Deep Options
2017/03/24 by Roy Fox, Fox, Roy, Sanjay Krishnan +5 · 20 citations
Computer Science · Decision Sciences · Engineering · #Reinforcement Learning in Robotics #Advanced Bandit Algorithms Research #Reservoir Engineering and Simulation Methods
- Skyplane: Optimizing Transfer Cost and Throughput Using Cloud-Aware Overlays
2022/10/13 by Paras Jain, Sam Kumar, Jain, Paras +9 · 1 voice · 5 citations
Computer Science · #Cloud Computing and Resource Management #Peer-to-Peer Network Technologies #Caching and Content Delivery
- Rethinking Benchmark and Contamination for Language Models with Rephrased Samples
2023/11/08 by Shuo Yang, Wei-Lin Chiang, Yang, Shuo +7 · 27 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Adversarial Robustness in Machine Learning
- RLlib: Abstractions for Distributed Reinforcement Learning
2017/12/26 by Eric Liang, Richard Liaw, Liang, Eric +15 · 1 voice · 5 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Modular Robots and Swarm Intelligence #Parallel #Reinforcement Learning in Robotics #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG
- Balsa: Learning a Query Optimizer Without Expert Demonstrations
2022/01/05 by Zongheng Yang, Wei-Lin Chiang, Sifei Luan +3 · 1 voice · 5 citations
Computer Science · #Advanced Database Systems and Queries #Data Management and Algorithms #Optimization and Search Problems #cs.DB #cs.LG
- The Sky Above The Clouds
2022/05/14 by Sarah Chasins, Alvin Cheung, Chasins, Sarah +32 · 2 voices
Business, Management and Accounting · Engineering · Computer Science · #Digital Platforms and Economics #Green IT and Sustainability #Cloud Computing and Resource Management
- Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems
2024/03/04 by Lingjiao Chen, Jared Quincy Davis, Chen, Lingjiao +11 · 26 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Law, AI, and Intellectual Property #Machine Learning (cs.LG) #Systems and Control (eess.SY) #electronic engineering #information engineering
- Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
2025/02/03 by Haocheng Xi, Shuo Yang, Xi, Haocheng +24 · 50 citations
Computer Science · Engineering · #Advanced Optical Imaging Technologies #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG)
- Online Speculative Decoding
2023/10/11 by Xiaoxuan Liu, Lanxiang Hu, Liu, Xiaoxuan +11 · 21 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
- Checkmate: Breaking the Memory Wall with Optimal Tensor Rematerialization
2019/10/07 by Paras Jain, Ajay N. Jain, Jain, Paras +13 · 14 citations
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
- Blink: Fast and Generic Collectives for Distributed ML
2019/10/11 by Guanhua Wang, Shivaram Venkataraman, Wang, Guanhua +9 · 12 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- How to Evaluate Reward Models for RLHF
2024/10/18 by Evan Frick, Frick, Evan, Tianle Li +15 · 27 citations
Decision Sciences · #Risk and Safety Analysis
- Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation
2025/06/24 by Xiangtan Li Xiangtan Li, Xingyang Li, Muyang Li +27 · 2 voices · 17 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Stochastic Gradient Optimization Techniques #cs.AI #cs.CV #cs.LG
- Fast Video Generation with Sliding Tile Attention
2025/02/06 by Zhang, Peiyuan, Yongqi Chen, Runlong Su +8 · 36 citations
Computer Science · Engineering · #Advanced Optical Imaging Technologies #Advanced Vision and Imaging #Cellular Automata and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents
2025/05/29 by Manish Shetty, Shetty, Manish, Naman Jain +9 · 2 voices · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #cs.AI #cs.CL #cs.LG #cs.SE
- FetchSGD: Communication-Efficient Federated Learning with Sketching
2020/07/15 by Daniel Rothchild, Rothchild, Daniel, Ashwinee Panda +13 · 10 citations
Computer Science · #Privacy-Preserving Technologies in Data #Mobile Crowdsensing and Crowdsourcing #Stochastic Gradient Optimization Techniques
- Accelerating Quadratic Optimization with Reinforcement Learning
2021/07/22 by Jeffrey Ichnowski, Ichnowski, Jeffrey, Paras Jain +15 · 10 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Data Classification #Optimization and Control (math.OC) #Reinforcement Learning in Robotics
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving
2023/02/22 by Zhuohan Li, Lianmin Zheng, Li, Zhuohan +19 · 13 citations
Computer Science · #Age of Information Optimization #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
- AutoPhase: Juggling HLS Phase Orderings in Random Forests with Deep Reinforcement Learning
2020/03/02 by Qijing Huang, Ameer Haj-Ali, Huang, Qijing +11 · 8 citations
Computer Science · Physics and Astronomy · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications #Parallel #Programming Languages (cs.PL) #Reinforcement Learning in Robotics #and Cluster Computing (cs.DC)
- Specifications: The missing link to making the development of LLM systems an engineering discipline
2024/11/25 by Ion Stoica, Matei Zaharia, Stoica, Ion +22 · 2 voices · 5 citations
Decision Sciences · Engineering · Mathematics · #Manufacturing Process and Optimization #Modeling, Simulation, and Optimization #Simulation Techniques and Applications #cs.AI #cs.CL #cs.SE
- Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules
2019/05/14 by Daniel E. Ho, Eric Liang, Ho, Daniel +7 · 9 citations
Computer Science · Decision Sciences · Economics, Econometrics and Finance · Social Sciences · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Health Systems, Economic Evaluations, Quality of Life #Healthcare innovation and challenges #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #demographic modeling and climate adaptation
- Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning
2022/01/28 by Lianmin Zheng, Zheng, Lianmin, Zhuohan Li +20 · 9 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #and Cluster Computing (cs.DC)
- MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving
2024/04/02 by Jiangfei Duan, Duan, Jiangfei, Runyu Lu +13 · 15 citations
Engineering · #Power Line Communications and Noise
- Ekya: Continuous Learning of Video Analytics Models on Edge Compute\n Servers
2020/12/18 by Romil Bhardwaj, Zhengxu Xia, Bhardwaj, Romil +15 · 8 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Image Enhancement Techniques #Parallel #and Cluster Computing (cs.DC)
- NeuroCard: One Cardinality Estimator for All Tables
2020/06/15 by Zongheng Yang, Yang, Zongheng, Amog Kamsetty +11 · 10 citations
Computer Science · #Advanced Database Systems and Queries #Data Management and Algorithms #Data Visualization and Analytics #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient LLM Scheduling by Learning to Rank
2024/08/28 by Yichao Fu, Siqi Zhu, Fu, Yichao +9 · 17 citations
Computer Science · #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
2024/11/18 by Shiyi Cao, Shu Liu, Cao, Shiyi +15 · 19 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
2021/04/29 by Jianfei Chen, Lianmin Zheng, Chen, Jianfei +11 · 7 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- BlinkDB: Queries with Bounded Errors and Bounded Response Times on Very Large Data
2012/03/25 by Sameer Agarwal, Aurojit Panda, Agarwal, Sameer +7 · 4 citations
Computer Science · #Data Management and Algorithms #Advanced Database Systems and Queries #Cloud Computing and Resource Management
- DistCache: Provable Load Balancing for Large-Scale Storage Systems with Distributed Caching
2019/01/23 by Zaoxing Liu, Liu, Zaoxing, Zhihao Bai +13 · 5 citations
Computer Science · #Caching and Content Delivery #Advanced Data Storage Technologies #Cloud Computing and Resource Management
- Scaling up Trustless DNN Inference with Zero-Knowledge Proofs
2022/10/17 by Daniel Kang, Tatsunori Hashimoto, Kang, Daniel +5 · 7 citations
Medicine · Computer Science · #COVID-19 diagnosis using AI #Medical Imaging Techniques and Applications #Advanced Neural Network Applications
- VSA: Faster Video Diffusion with Trainable Sparse Attention
2025/05/19 by Yongqi Chen, Zhang, Peiyuan, Chen, Yongqi +11 · 27 citations
Computer Science · Medicine · #Advanced Neuroimaging Techniques and Applications #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis
- SparkNet: Training Deep Networks in Spark
2015/11/19 by Philipp Moritz, Robert Nishihara, Moritz, Philipp +5 · 1 voice · 1 citation
Computer Science · Mathematics · #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural and Evolutionary Computing (cs.NE) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG #cs.NE #math.OC #stat.ML
- Fairness in Serving Large Language Models
2023/12/31 by Ying Sheng, Shiyi Cao, Sheng, Ying +13 · 9 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Performance (cs.PF)
- NetChain: Scale-Free Sub-RTT Coordination (Extended Version)
2018/02/22 by Xin Jin, Xiaozhou Li, Jin, Xin +13 · 2 voices
#cs.DC
- ZK-IMG: Attested Images via Zero-Knowledge Proofs to Fight Disinformation
2022/11/09 by Daniel Kang, Tatsunori Hashimoto, Kang, Daniel +5 · 1 voice · 2 citations
Computer Science · #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #cs.CR
- Post-Training Sparse Attention with Double Sparsity
2024/08/11 by Shuo Yang, Ying Sheng, Yang, Shuo +7 · 12 citations
Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #EEG and Brain-Computer Interfaces #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Helen: Maliciously Secure Coopetitive Learning for Linear Models
2019/07/16 by Wenting Zheng, Raluca Ada Popa, Joseph E. Gonzalez +1 · 1 voice · 1 citation
Computer Science · #cs.CR #cs.LG
- SuperServe: Fine-Grained Inference Serving for Unpredictable Workloads
2023/12/27 by Alind Khare, Dhruv Garg, Khare, Alind +9 · 7 citations
Computer Science · #Advanced Data Storage Technologies #Parallel Computing and Optimization Techniques #Caching and Content Delivery
- Autellix: An Efficient Serving Engine for LLM Agents as General Programs
2025/02/19 by Michael Luo, Luo, Michael, Shi, Xiaoxiang +17 · 13 citations
Computer Science · Engineering · #Mobile Agent-Based Network Management #Modular Robots and Swarm Intelligence #Advanced Manufacturing and Logistics Optimization
- Communication-efficient distributed SGD with Sketching
2019/03/12 by Nikita Ivkin, Ivkin, Nikita, Daniel Rothchild +9 · 4 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Parallel #Privacy-Preserving Technologies in Data #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- TurboSpec: Closed-loop Speculation Control System for Optimizing LLM Serving Goodput
2024/06/20 by Xiaoxuan Liu, Liu, Xiaoxuan, Langxiang Hu +19 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Natural Language Processing Techniques #Performance (cs.PF) #Topic Modeling
- AutoPhase: Compiler Phase-Ordering for High Level Synthesis with Deep Reinforcement Learning
2019/01/15 by Ameer Haj-Ali, Haj-Ali, Ameer, Qijing Huang +11 · 3 citations
Computer Science · #Evolutionary Algorithms and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #Software Engineering Research
- M2RNN: Non-Linear RNNs with Matrix-Valued States for Scalable Language Modeling
2026/03/15 by Mayank Mishra, Shawn Tan, Ion Stoica +2 · 2 voices
#cs.LG #cs.AI
- Dynamic Space-Time Scheduling for GPU Inference
2018/12/31 by Paras Jain, Xiangxi Mo, Jain, Paras +13 · 4 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- PrefillOnly: An Inference Engine for Prefill-only Workloads in Large Language Model Applications
2025/05/12 by Kuntai Du, Du, Kuntai, Bowen Wang +19 · 13 citations
Computer Science · Materials Science · #Big Data and Digital Economy #Distributed #FOS: Computer and information sciences #Machine Learning in Materials Science #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Neural Packet Classification
2019/02/27 by Eric Liang, Hang Zhu, Liang, Eric +5 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization #Network Security and Intrusion Detection #Networking and Internet Architecture (cs.NI) #Protein Degradation and Inhibitors
- Optimizing LLM Queries in Relational Data Analytics Workloads
2024/03/09 by Shuming Liu, A. Biswal, Liu, Shu +16 · 6 citations
Computer Science · #Advanced Database Systems and Queries #Data Mining Algorithms and Applications #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
- Scaling Replicated State Machines with Compartmentalization [Technical Report]
2020/12/31 by Michael Whittaker, Ailidani Ailijiang, Whittaker, Michael +15 · 3 citations
Computer Science · #Advanced Data Storage Technologies #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Optimization and Search Problems #Parallel #and Cluster Computing (cs.DC)
- LLM-Assisted Code Cleaning For Training Accurate Code Generators
2023/11/25 by Naman Jain, Jain, Naman, Tianjun Zhang +9 · 5 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Software Engineering (cs.SE) #Software Engineering Research #Software Testing and Debugging Techniques
- Twilight: Adaptive Attention Sparsity with Hierarchical Top-p Pruning
2025/02/04 by Lin, Chaofan, Shuo Yang, Tang, Jiaming +13 · 9 citations
Computer Science · Decision Sciences · #Intelligent Tutoring Systems and Adaptive Learning #Online Learning and Analytics #Advanced Bandit Algorithms Research
- FogROS2: An Adaptive Platform for Cloud and Fog Robotics Using ROS 2
2022/05/19 by Jeffrey Ichnowski, Ichnowski, Jeffrey, Kaiyuan Chen +27 · 3 citations
Computer Science · Engineering · #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Modular Robots and Swarm Intelligence #Robotics (cs.RO) #Robotics and Automated Systems
- GameArena: Evaluating LLM Reasoning through Live Computer Games
2024/12/09 by Lanxiang Hu, Qiyu Li, Hu, Lanxiang +8 · 8 citations
Computer Science · Social Sciences · #Multi-Agent Systems and Negotiation #Artificial Intelligence in Law #Software Engineering Research
- A Berkeley View of Systems Challenges for AI
2017/12/15 by Ion Stoica, Stoica, Ion, Dawn Song +25 · 3 citations
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning and Algorithms #Reinforcement Learning in Robotics #Scientific Computing and Data Management
- On Optimizing the Communication of Model Parallelism
2022/11/10 by Yonghao Zhuang, Hexu Zhao, Zhuang, Yonghao +15 · 3 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Understanding the impact of video quality on user engagement
2013/02/22 by Florin Dobrian, Asad Awan, Dilip Joseph +5 · 4 citations
Computer Science · #Image and Video Quality Assessment #Peer-to-Peer Network Technologies #Caching and Content Delivery
- Pie: Pooling CPU Memory for LLM Inference
2024/11/14 by Yi Xu, Xu, Yi, Ziming Mao +7 · 7 citations
Computer Science · #Advanced Data Storage Technologies #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Resource Allocation in Multi-armed Bandit Exploration: Overcoming Sublinear Scaling with Adaptive Parallelism
2020/10/31 by Brijen Thananjeyan, Kirthevasan Kandasamy, Thananjeyan, Brijen +9 · 2 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Reinforcement Learning in Robotics #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Trustless Audits without Revealing Data or Models
2024/04/06 by Suppakit Waiwitlikhit, Waiwitlikhit, Suppakit, Ion Stoica +7 · 4 citations
Computer Science · #Blockchain Technology Applications and Security
- BlendServe: Optimizing Offline Inference for Auto-regressive Large Models with Resource-aware Batching
2024/11/25 by Yilong Zhao, Shuo Yang, Zhao, Yilong +13 · 7 citations
Computer Science · #AI in cancer detection #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning and Data Classification
- MPC-Minimized Secure LLM Inference
2024/08/07 by Deevashwer Rathee, Rathee, Deevashwer, Dacheng Li +7 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Interconnection Networks and Systems #Machine Learning (cs.LG)
- VisionArena: 230K Real World User-VLM Conversations with Preference Labels
2024/12/11 by Christopher Chou, Chou, Christopher, Lisa Dunlap +12 · 5 citations
Environmental Science · #Impact of Light on Environment and Health
- Advancing Science- and Evidence-based AI Policy
2025/07/31 by Rishi Bommasani, Bommasani, Rishi, Sanjeev Arora +37 · 1 voice · 6 citations
Medicine · Computer Science · #Computers and Society (cs.CY) #FOS: Computer and information sciences
- Copilot Arena: A Platform for Code LLM Evaluation in the Wild
2025/02/13 by Wayne Chi, Chi, Wayne, Valerie Chen +16 · 8 citations
Computer Science · #Digital and Cyber Forensics #FOS: Computer and information sciences #Natural Language Processing Techniques #Software Engineering (cs.SE)
- HashAttention: Semantic Sparsity for Faster Inference
2024/12/19 by Aditya Desai, Desai, Aditya, Shuo Yang +9 · 6 citations
Computer Science · Medicine · #Cryptography and Data Security #Big Data and Digital Economy #COVID-19 diagnosis using AI
- InferLine: ML Prediction Pipeline Provisioning and Management for Tight Latency Objectives
2018/12/05 by Daniel Crankshaw, Crankshaw, Daniel, Gur-Eyal Sela +11 · 2 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning and Data Classification #Parallel #Software Testing and Debugging Techniques #Web Data Mining and Analysis #and Cluster Computing (cs.DC)
- Locality-aware Fair Scheduling in LLM Serving
2025/01/24 by Shiyi Cao, Cao, Shiyi, Yichuan Wang +22 · 4 citations
Computer Science · Engineering · #Advanced Manufacturing and Logistics Optimization #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Petri Nets in System Modeling #Scheduling and Optimization Algorithms #and Cluster Computing (cs.DC)
- BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation
2025/02/03 by Alan Zhu, Parth Asawa, Zhu, Alan +12 · 4 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- An Extensible Software Transport Layer for GPU Networking
2025/04/24 by Yang Zhou, Zhongjie Chen, Zhou, Yang +25 · 6 citations
Computer Science · #Cloud Computing and Resource Management #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Networking and Internet Architecture (cs.NI)
- Harmonia: Near-Linear Scalability for Replicated Storage with In-Network Conflict Detection
2019/04/18 by Hang Zhu, Zhihao Bai, Zhu, Hang +11 · 1 citation
Computer Science · #Advanced Data Storage Technologies #Caching and Content Delivery #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Real-Time Machine Learning: The Missing Pieces
2017/03/11 by Robert Nishihara, Nishihara, Robert, Philipp Moritz +17 · 1 voice · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG
- Hierarchical Variational Imitation Learning of Control Programs
2019/12/29 by Roy Fox, Richard Shin, Fox, Roy +13 · 1 citation
Computer Science · Engineering · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Reinforcement Learning in Robotics #Robot Manipulation and Learning
- optimizeanything: Unified Text Optimization can Outperform Specialized Systems
2026/05/19 by Lakshya A Agrawal, Donghyun Lee, Shangyin Tan +11 · 1 voice
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG #cs.NE #cs.SE
- Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile
2025/02/10 by Hangliang Ding, Dacheng Li, Ding, Hangliang +9 · 4 citations
Engineering · Computer Science · #Advanced Memory and Neural Computing #Advanced Optical Imaging Technologies #Neural Networks and Reservoir Computing
- TurboDiffusion: Accelerating Video Diffusion Models by 100-200 Times
2025/12/18 by Jintao Zhang, Zhang, Jintao, Kaiwen Zheng +14 · 1 voice · 1 citation
Computer Science · #Advanced Image Processing Techniques #Computer Graphics and Visualization Techniques #Generative Adversarial Networks and Image Synthesis #cs.AI #cs.CV #cs.LG
- The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More
2026/03/25 by Lingjiao Chen, Chi Zhang, Yeye He +3 · 2 voices
Computer Science · #cs.CL #cs.AI #cs.GT #cs.LG #cs.MA
- Hoplite: Efficient and Fault-Tolerant Collective Communication for Task-Based Distributed Systems
2020/02/13 by Siyuan Zhuang, Zhuang, Siyuan, Zhuohan Li +13 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Machine Learning (cs.LG) #Networking and Internet Architecture (cs.NI) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Composing MPC with LQR and Neural Network for Amortized Efficiency and Stable Control
2021/12/14 by Fangyu Wu, Wu, Fangyu, Guanhua Wang +11 · 1 citation
Engineering · #Advanced Control Systems Optimization #Control Systems and Identification #FOS: Electrical engineering #Fuel Cells and Related Materials #Systems and Control (eess.SY) #electronic engineering #information engineering
- Grounded Graph Decoding Improves Compositional Generalization in Question Answering
2021/11/05 by Yu Gai, Paras Jain, Gai, Yu +9 · 1 citation
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- ProTuner: Tuning Programs with Monte Carlo Tree Search
2020/05/27 by Ameer Haj-Ali, Haj-Ali, Ameer, Hasan Genc +11 · 1 voice
Computer Science · #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #Programming Languages (cs.PL) #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG #cs.PF #cs.PL
- Context-Aware Streaming Perception in Dynamic Environments
2022/08/16 by Gur-Eyal Sela, Sela, Gur-Eyal, Ionel Gog +21 · 1 citation
Computer Science · Physics and Astronomy · #Advanced Optical Sensing Technologies #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Visual Attention and Saliency Detection
- LEANN: A Low-Storage Vector Index
2025/06/09 by Yichuan Wang, Wang, Yichuan, Zhifei Li +23 · 3 citations
Computer Science · #Advanced Graph Neural Networks #Advanced Image and Video Retrieval Techniques #Databases (cs.DB) #FOS: Computer and information sciences #Information Retrieval and Search Behavior #Machine Learning (cs.LG)
- K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model
2026/02/22 by Shiyi Cao, Ziming Mao, Joseph E. Gonzalez +1 · 1 voice
Computer Science · #cs.AI
- Leveraging Cloud Computing to Make Autonomous Vehicles Safer
2023/08/06 by Peter Schafhalter, Sukrit Kalra, Schafhalter, Peter +7 · 1 citation
Computer Science · Engineering · #Advanced Neural Network Applications #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Robotics (cs.RO) #Vehicular Ad Hoc Networks (VANETs)
- CodeScholar: Growing Idiomatic Code Examples
2023/12/23 by Manish Shetty, Shetty, Manish, Koushik Sen +3 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Open Source Software Innovations #Programming Languages (cs.PL) #Software Engineering (cs.SE) #Software Engineering Research #Software Engineering Techniques and Practices
- Variable Skipping for Autoregressive Range Density Estimation
2020/07/10 by Eric Liang, Liang, Eric, Zongheng Yang +9 · 2 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Data Management and Algorithms #Databases (cs.DB) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- A Statistical Framework for Ranking LLM-Based Chatbots
2024/12/24 by Siavash Ameli, Ameli, Siavash, Siyuan Zhuang +5 · 1 voice · 1 citation
Computer Science · #AI in Service Interactions #cs.AI #cs.LG #stat.ML
- EDIT-Bench: Evaluating LLM Abilities to Perform Real-World Instructed Code Edits
2025/11/06 by Wayne Chi, Chi, Wayne, Valerie Chen +18 · 3 citations
Computer Science · #Software Engineering Research #Software Testing and Debugging Techniques #Teaching and Learning Programming
- HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs
2025/04/04 by Yang Wu, Xueshen Liu, Wu, Yongji +15 · 2 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Big Data and Digital Economy
- Bipartisan Paxos: A Modular State Machine Replication Protocol
2020/02/29 by Michael Whittaker, Neil Giridharan, Whittaker, Michael +7 · 2 citations
Computer Science · #Advanced Data Storage Technologies #Distributed #Distributed systems and fault tolerance #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- vAttention: Verified Sparse Attention
2025/10/07 by Aditya Desai, Desai, Aditya, Kumar Krishna Agrawal +13 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient Long-context Language Model Training by Core Attention Disaggregation
2025/10/20 by Yonghao Zhuang, Zhuang, Yonghao, Bo Pang +14 · 1 citation
Computer Science · #Big Data and Digital Economy #Advanced Neural Network Applications #Natural Language Processing Techniques
- The Streaming Batch Model for Efficient and Fault-Tolerant Heterogeneous Execution
2025/01/16 by Frank Sifei Luan, Luan, Frank Sifei, Wang, Ron Yifeng +24 · 1 citation
Computer Science · #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #Distributed systems and fault tolerance #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
2025/12/01 by Yilong Zhao, Jiaming Tang, Zhao, Yilong +21 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- SonicMoE: Accelerating MoE with IO and Tile-aware Optimizations
2025/12/16 by Guo, Wentao, Mayank Mishra, Mishra, Mayank +6 · 1 citation
Computer Science · #Topic Modeling #Mobile Crowdsensing and Crowdsourcing #Advanced Neural Network Applications
- Denial of Deadline: Network-Driven Accuracy Collapse in Distributed Inference Pipelines
2026/07/27 by Jhonatan Tavori, Gur-Eyal Sela, Ion Stoica +1
#cs.NI #cs.AI #cs.CR #cs.DC
- Fantastic Adaptive Taxonomies and How to Use Them
2026/07/17 by Mert Cemri, Andrei Cojocaru, Melissa Pan +9
Computer Science · #cs.AI #cs.SE