Alexey Tumanov
- Serverless Computing: One Step Forward, Two Steps Back
2018/12/10 by Joseph M. Hellerstein, Jose Faleiro, Hellerstein, Joseph M. +11 · 5 voices · 12 citations
#cs.DC #cs.DB
- Ray: A Distributed Framework for Emerging AI Applications
2017/12/16 by Philipp Moritz, Robert Nishihara, Moritz, Philipp +19 · 1 voice · 134 citations
Computer Science · #Cloud Computing and Resource Management #Parallel Computing and Optimization Techniques #Reinforcement Learning in Robotics #cs.AI #cs.DC #cs.LG #stat.ML
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
2024/03/04 by Amey Agrawal, Nitin Kedia, Agrawal, Amey +13 · 133 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- Vidur: A Large-Scale Simulation Framework For LLM Inference
2024/05/08 by Amey Agrawal, Agrawal, Amey, Nitin Kedia +13 · 24 citations
Decision Sciences · #Simulation Techniques and Applications
- HOLMES: Health OnLine Model Ensemble Serving for Deep Learning Models in Intensive Care Units
2020/08/10 by Shenda Hong, Hong, Shenda, Yanbo Xu +13 · 10 citations
Computer Science · Medicine · #FOS: Computer and information sciences #Healthcare Technology and Patient Monitoring #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning in Healthcare #Sepsis Diagnosis and Treatment
- SuperServe: Fine-Grained Inference Serving for Unpredictable Workloads
2023/12/27 by Alind Khare, Dhruv Garg, Khare, Alind +9 · 7 citations
Computer Science · #Advanced Data Storage Technologies #Parallel Computing and Optimization Techniques #Caching and Content Delivery
- RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression
2025/02/19 by Payman Behnam, Behnam, Payman, Yaosheng Fu +9 · 12 citations
Computer Science · #Advanced Data Storage Technologies #Algorithms and Data Compression #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization
- Dynamic Space-Time Scheduling for GPU Inference
2018/12/31 by Paras Jain, Jain, Paras, Xiangxi Mo +13 · 5 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- IDK Cascades: Fast Deep Learning by Learning not to Overthink
2017/06/03 by Xin Wang, Yujia Luo, Wang, Xin +9 · 3 citations
Computer Science · #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning and Data Classification
- No Request Left Behind: Tackling Heterogeneity in Long-Context LLM Inference with Medha
2024/09/25 by Amey Agrawal, Haoran Qiu, Agrawal, Amey +13 · 8 citations
Computer Science · #Semantic Web and Ontologies
- Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
2024/11/29 by Kaustubh Ponkshe, Raghav Singhal, Ponkshe, Kaustubh +9 · 10 citations
Engineering · #Advancements in PLL and VCO Technologies #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Microwave Engineering and Waveguides #Radio Frequency Integrated Circuit Design
- CompOFA: Compound Once-For-All Networks for Faster Multi-Platform Deployment
2021/04/26 by Manas Sahni, Shreya Varshini, Sahni, Manas +5 · 2 citations
Computer Science · Materials Science · #Advanced Neural Network Applications #Machine Learning in Materials Science #Adversarial Robustness in Machine Learning
- InferLine: ML Prediction Pipeline Provisioning and Management for Tight Latency Objectives
2018/12/05 by Daniel Crankshaw, Gur-Eyal Sela, Crankshaw, Daniel +11 · 2 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning and Data Classification #Parallel #Software Testing and Debugging Techniques #Web Data Mining and Analysis #and Cluster Computing (cs.DC)
- Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
2024/07/09 by Amey Agrawal, Anmol Agarwal, Agrawal, Amey +13 · 3 citations
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #Data Quality and Management #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Semantic Web and Ontologies #and Cluster Computing (cs.DC)
- Real-Time Machine Learning: The Missing Pieces
2017/03/11 by Robert Nishihara, Philipp Moritz, Nishihara, Robert +17 · 1 voice · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Cloud Computing and Resource Management #Data Stream Mining Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC) #cs.AI #cs.DC #cs.LG
- Pareto-Secure Machine Learning (PSML): Fingerprinting and Securing Inference Serving Systems
2023/07/03 by Debopam Sanyal, J.C. Hung, Sanyal, Debopam +15 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Network Security and Intrusion Detection #Privacy-Preserving Technologies in Data
- On Evaluating Performance of LLM Inference Serving Systems
2025/07/11 by Amey Agrawal, Nitin Kedia, Agrawal, Amey +13 · 3 citations
Computer Science · #Service-Oriented Architecture and Web Services #Distributed and Parallel Computing Systems
- LayoutBench: Performance Benchmarking of Cloud Storage Layouts for Multimedia Data
2026/07/30 by Debopam Sanyal, Hongjie Chen, Alexey Tumanov +1
Computer Science · #cs.DC #cs.DB #cs.LG