Matei Zaharia
- On the Opportunities and Risks of Foundation Models
2021/08/16 by Rishi Bommasani, Bommasani, Rishi, Drew A. Hudson +233 · 11 voices · 535 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #Topic Modeling
- How is ChatGPT's behavior changing over time?
2023/07/18 by Lingjiao Chen, Chen, Lingjiao, Matei Zaharia +3 · 8 voices · 34 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Topic Modeling #cs.AI #cs.CL #cs.LG
- FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
2023/05/09 by Lingjiao Chen, Matei Zaharia, Chen, Lingjiao +3 · 4 voices · 93 citations
Computer Science · #Privacy-Preserving Technologies in Data #Recommender Systems and Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG #cs.SE
- Ring Attention with Blockwise Transformers for Near-Infinite Context
2023/10/03 by Hao Liu, Matei Zaharia, Liu, Hao +3 · 1 voice · 97 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
2025/04/27 by Lakshya A Agrawal, Shangyin Tan, Agrawal, Lakshya A +33 · 7 voices · 70 citations
Computer Science · #Machine Learning and Data Classification #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #cs.AI #cs.CL #cs.LG #cs.SE
- Measuring Agents in Production
2025/12/02 by Melissa Z. Pan, Pan, Melissa Z., Negar Arabzadeh +47 · 11 voices · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE) #cs.AI #cs.CY #cs.LG #cs.SE
- ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT
2020/04/27 by Omar Khattab, Matei Zaharia, Khattab, Omar +1 · 172 citations
Computer Science · #Topic Modeling #Web Data Mining and Analysis #Natural Language Processing Techniques
- ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
2021/12/02 by Keshav Santhanam, Santhanam, Keshav, Omar Khattab +7 · 2 voices · 66 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Information Retrieval and Search Behavior
- Supporting Our AI Overlords: Redesigning Data Systems to be Agent-First
2025/08/31 by Shu Liu, Liu, Shu, Soujanya Ponnapalli +28 · 11 voices · 6 citations
Computer Science · #Big Data and Digital Economy #Semantic Web and Ontologies #Graph Theory and Algorithms
- Efficient Large-Scale Language Model Training on GPU Clusters Using\n Megatron-LM
2021/04/09 by Deepak Narayanan, Narayanan, Deepak, Mohammad Shoeybi +21 · 105 citations
Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Beyond Data and Model Parallelism for Deep Neural Networks
2018/07/14 by Zhihao Jia, Matei Zaharia, Jia, Zhihao +3 · 1 voice · 25 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC) #cs.DC
- DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines
2023/10/05 by Omar Khattab, Arnav Singhvi, Khattab, Omar +23 · 120 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Software Engineering Research
- Reasoning Models Can Be Effective Without Thinking
2025/04/14 by Wenjie Ma, Ma, Wenjie, Jingxuan He +9 · 1 voice · 39 citations
Computer Science · Decision Sciences · #Complex Systems and Decision Making #Logic, Reasoning, and Knowledge #cs.AI #cs.CL
- RAFT: Adapting Language Model to Domain Specific RAG
2024/03/15 by Tianjun Zhang, Zhang, Tianjun, Shishir G. Patil +11 · 1 voice · 31 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- Sparse GPU Kernels for Deep Learning
2020/06/18 by Trevor Gale, Gale, Trevor, Matei Zaharia +5 · 1 voice · 13 citations
#cs.LG #cs.DC #stat.ML
- Selection via Proxy: Efficient Data Selection for Deep Learning
2019/06/26 by Cody Coleman, Coleman, Cody, Christopher Yeh +13 · 31 citations
Computer Science · #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification
- Barbarians at the Gate: How AI is Upending Systems Research
2025/10/07 by Audrey Cheng, Cheng, Audrey, Shu Liu +32 · 4 voices · 10 citations
Social Sciences · #Ethics and Social Impacts of AI #cs.AI
- Exploiting Programmatic Behavior of LLMs: Dual-Use Through Standard Security Attacks
2023/02/11 by Daniel Kang, Kang, Daniel, Xuechen Li +9 · 40 citations
Computer Science · #Topic Modeling #Software Engineering Research #Natural Language Processing Techniques
- Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP
2022/12/28 by Omar Khattab, Keshav Santhanam, Khattab, Omar +11 · 36 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs
2024/06/17 by Krista Opsahl-Ong, Opsahl-Ong, Krista, Michael J. Ryan +11 · 44 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Natural Language Processing Techniques #Topic Modeling
- MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
2022/11/29 by Trevor Gale, Gale, Trevor, Deepak Narayanan +5 · 24 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
- Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads
2020/08/20 by Deepak Narayanan, Keshav Santhanam, Narayanan, Deepak +7 · 18 citations
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- MLPerf Training Benchmark
2019/10/02 by Peter Mattson, Christine Cheng, Mattson, Peter +71 · 19 citations
Computer Science · #Advanced Neural Network Applications #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Performance (cs.PF)
- LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters!
2025/02/11 by Dacheng Li, Shiyi Cao, Li, Dacheng +21 · 2 voices · 33 citations
Social Sciences · Economics, Econometrics and Finance · #cs.AI
- DBOS: A Proposal for a Data-Centric Operating System
2020/07/21 by Michael Cafarella, David DeWitt, Cafarella, Michael +13 · 4 voices
#cs.OS #cs.AR #cs.DB #cs.DC #cs.NI
- Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems
2024/03/04 by Lingjiao Chen, Jared Quincy Davis, Chen, Lingjiao +11 · 17 citations
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Law, AI, and Intellectual Property #Machine Learning (cs.LG) #Systems and Control (eess.SY) #electronic engineering #information engineering
- ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data
2024/03/07 by Liana Patel, Peter Kraft, Patel, Liana +5 · 16 citations
Computer Science · #Machine Learning in Healthcare
- Specifications: The missing link to making the development of LLM systems an engineering discipline
2024/11/25 by Ion Stoica, Matei Zaharia, Stoica, Ion +22 · 2 voices · 5 citations
Decision Sciences · Engineering · Mathematics · #Manufacturing Process and Optimization #Modeling, Simulation, and Optimization #Simulation Techniques and Applications #cs.AI #cs.CL #cs.SE
- MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs
2024/11/18 by Shiyi Cao, Shu Liu, Cao, Shiyi +15 · 17 citations
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Distributed #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Long Context RAG Performance of Large Language Models
2024/11/05 by Quinn Leng, Leng, Quinn, Jacob Portes +7 · 3 voices · 6 citations
Computer Science · #Topic Modeling
- ElasticTok: Adaptive Tokenization for Image and Video
2024/10/10 by Wilson Yan, Volodymyr Mnih, Yan, Wilson +9 · 1 voice · 7 citations
Computer Science · #cs.LG
- Infrastructure for Usable Machine Learning: The Stanford DAWN Project
2017/05/22 by Peter Bailis, Kunle Olukotun, Bailis, Peter +5 · 2 voices
#cs.LG #cs.DB #stat.ML
- Drowning in Documents: Consequences of Scaling Reranker Inference
2024/11/18 by Mathew Jacob, Jacob, Mathew, Erik Lindgren +9 · 7 voices
#cs.IR #cs.CL #cs.LG
- FrugalML: How to Use ML Prediction APIs More Accurately and Cheaply
2020/06/12 by Lingjiao Chen, Chen, Lingjiao, Matei Zaharia +3 · 3 citations
Computer Science · #Computer Science and Game Theory (cs.GT) #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sentiment Analysis and Opinion Mining #Topic Modeling
- Optimizing LLM Queries in Relational Data Analytics Workloads
2024/03/09 by Shuming Liu, Liu, Shu, A. Biswal +16 · 5 citations
Computer Science · #Advanced Database Systems and Queries #Data Mining Algorithms and Applications #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Semantic Web and Ontologies
- DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines
2023/12/20 by Arnav Singhvi, Manish Shetty, Singhvi, Arnav +11 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Programming Languages (cs.PL) #Software Engineering Research #Topic Modeling
- Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval
2021/01/02 by Omar Khattab, Christopher Potts, Khattab, Omar +3 · 3 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- NoScope: Optimizing Neural Network Queries over Video at Scale
2017/03/07 by Daniel Kang, Kang, Daniel, John Emmons +7 · 2 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Databases (cs.DB) #FOS: Computer and information sciences #Human Pose and Action Recognition #Video Surveillance and Tracking Methods
- HashAttention: Semantic Sparsity for Faster Inference
2024/12/19 by Aditya Desai, Desai, Aditya, Shuo Yang +9 · 5 citations
Computer Science · Medicine · #Cryptography and Data Security #Big Data and Digital Economy #COVID-19 diagnosis using AI
- BARE: Leveraging Base Language Models for Few-Shot Synthetic Data Generation
2025/02/03 by Alan Zhu, Zhu, Alan, Parth Asawa +12 · 4 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- optimizeanything: Unified Text Optimization can Outperform Specialized Systems
2026/05/19 by Lakshya A Agrawal, Donghyun Lee, Shangyin Tan +11 · 1 voice
Computer Science · #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG #cs.NE #cs.SE
- The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More
2026/03/25 by Lingjiao Chen, Chi Zhang, Yeye He +3 · 2 voices
Computer Science · #cs.CL #cs.AI #cs.GT #cs.LG #cs.MA
- Weld: Rethinking the Interface Between Data-Intensive Applications
2017/09/14 by Shoumik Palkar, James Thomas, Palkar, Shoumik +17 · 1 voice
Computer Science · #Databases (cs.DB) #Distributed #FOS: Computer and information sciences #Parallel #Performance (cs.PF) #and Cluster Computing (cs.DC) #cs.DB #cs.DC #cs.PF
- The Cambridge Report on Database Research
2025/04/15 by Anastasia Ailamaki, Ailamaki, Anastasia, Samuel Madden +96 · 1 voice
Business, Management and Accounting · Computer Science · Decision Sciences · #Big Data Technologies and Applications #Big Data and Business Intelligence #Cloud Computing and Resource Management #cs.DB
- AI-to-AI Feedback: Amplified Intelligence — Prior Art and Governance Implications for Multi-Model Advisory Architectures
2025/10/02 by Asawa, Parth, Alan Zhu, Zhu, Alan +7 · 3 citations
Medicine · Computer Science · #Artificial Intelligence in Healthcare and Education #Machine Learning and Data Classification #Topic Modeling
- Data Acquisition: A New Frontier in Data-centric AI
2023/11/22 by Lingjiao Chen, Bilge Acun, Chen, Lingjiao +19 · 1 citation
Decision Sciences · Business, Management and Accounting · Computer Science · #Data Quality and Management #Big Data and Business Intelligence #Privacy-Preserving Technologies in Data
- Efficient Online ML API Selection for Multi-Label Classification Tasks
2021/02/18 by Lingjiao Chen, Chen, Lingjiao, Matei Zaharia +3 · 1 citation
Computer Science · #Text and Document Classification Technologies #Web Data Mining and Analysis #Sentiment Analysis and Opinion Mining
- vCache: Verified Semantic Prompt Caching
2025/02/06 by Luis Gaspar Schroeder, Aditya Desai, Schroeder, Luis Gaspar +18 · 1 citation
Computer Science · #Caching and Content Delivery #Service-Oriented Architecture and Web Services #Cognitive Computing and Networks
- vAttention: Verified Sparse Attention
2025/10/07 by Aditya Desai, Desai, Aditya, Kumar Krishna Agrawal +13 · 2 citations
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Fantastic Adaptive Taxonomies and How to Use Them
2026/07/17 by Mert Cemri, Andrei Cojocaru, Melissa Pan +9
Computer Science · #cs.AI #cs.SE
- Recursive Harness Self-Improvement
2026/07/17 by Hyunin Lee, Jinglue Xu, Jeffrey Seely +3
#cs.LG #cs.AI