Venkataraman, Shivaram
- numpywren: serverless linear algebra
2018/10/23 by Vaishaal Shankar, Shankar, Vaishaal, Karl Krauth +14 · 3 voices · 4 citations
Computer Science · #cs.DC
- Occupy the Cloud: Distributed Computing for the 99%
2017/02/13 by Eric Jonas, Qifan Pu, Jonas, Eric +7 · 1 voice · 9 citations
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #IoT and Edge/Fog Computing #cs.DC
- Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads
2019/01/17 by Myeongjae Jeon, Jeon, Myeongjae, Shivaram Venkataraman +9 · 28 citations
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Themis: Fair and Efficient GPU Cluster Scheduling
2019/07/02 by Kshiteej Mahajan, Mahajan, Kshiteej, Arjun Balasubramanian +11 · 12 citations
Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #IoT and Edge/Fog Computing #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning
2021/02/02 by Yuhan Liu, Saurabh Agarwal, Liu, Yuhan +3 · 9 citations
Computer Science · #Topic Modeling #Advanced Neural Network Applications #Machine Learning and Data Classification
- LlamaTune: Sample-Efficient DBMS Configuration Tuning
2022/03/10 by Konstantinos Kanellis, Cong Ding, Kanellis, Konstantinos +9 · 9 citations
Computer Science · #Cloud Computing and Resource Management #Data Stream Mining Techniques #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning and Data Classification
- Blink: Fast and Generic Collectives for Distributed ML
2019/10/11 by Guanhua Wang, Wang, Guanhua, Shivaram Venkataraman +9 · 8 citations
Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learning
2022/09/30 by Zheng, Pengfei, Pan, Rui, Khan, Tarannum +2 · 6 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Decoding Speculative Decoding
2024/02/02 by Minghao Yan, Yan, Minghao, Saurabh Agarwal +3 · 9 citations
Computer Science · #Cellular Automata and Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MLlib: Machine Learning in Apache Spark
2015/05/26 by Meng, Xiangrui, Bradley, Joseph, Yavuz, Burak +13 · 3 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Mathematical Software (cs.MS) #Parallel #and Cluster Computing (cs.DC)
- Not All GPUs Are Created Equal: Characterizing Variability in Large-Scale, Accelerator-Rich Systems
2022/08/23 by Prasoon Sinha, Sinha, Prasoon, Akhil Guliani +9 · 5 citations
Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- BagPipe: Accelerating Deep Recommendation Model Training
2022/02/24 by Saurabh Agarwal, Agarwal, Saurabh, Ziyi Zhang +4 · 4 citations
Computer Science · #Caching and Content Delivery #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification
2020/10/29 by Agarwal, Saurabh, Wang, Hongyi, Lee, Kangwook +2 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Scaling Inference-Efficient Language Models
2025/01/30 by Bian, Song, Yan, Minghao, Venkataraman, Shivaram · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- KeystoneML: Optimizing Pipelines for Large-Scale Advanced Analytics
2016/10/29 by Sparks, Evan R., Venkataraman, Shivaram, Kaftan, Tomer +2 · 1 citation
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Breaking Locality Accelerates Block Gauss-Seidel
2017/01/14 by Tu, Stephen, Venkataraman, Shivaram, Wilson, Ashia C. +3 · 1 citation
#FOS: Mathematics #Numerical Analysis (math.NA) #Optimization and Control (math.OC)
- On the Utility of Gradient Compression in Distributed Training Systems
2021/02/28 by Saurabh Agarwal, Agarwal, Saurabh, Hongyi Wang +5 · 2 citations
Computer Science · Medicine · #Stochastic Gradient Optimization Techniques #Advanced MRI Techniques and Applications #Medical Imaging Techniques and Applications
- Accelerating Deep Learning Inference via Freezing
2020/02/07 by Adarsh Kumar, Arjun Balasubramanian, Kumar, Adarsh +5 · 1 citation
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Stochastic Gradient Optimization Techniques
- Accelerating Deep Learning Inference via Learned Caches
2021/01/18 by Balasubramanian, Arjun, Kumar, Adarsh, Liu, Yuhan +3 · 1 citation
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Performance (cs.PF) #and Cluster Computing (cs.DC)
- Scaling Laws Meet Model Architecture: Toward Inference-Efficient LLMs
2025/10/21 by Song Bian, Tao Yu, Bian, Song +5 · 1 voice
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.LG
- Incremental IVF Index Maintenance for Streaming Vector Search
2024/11/01 by Mohoney, Jason, Pacaci, Anil, Chowdhury, Shihabur Rahman +7 · 2 citations
#Artificial Intelligence (cs.AI) #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- MariusGNN: Resource-Efficient Out-of-Core Training of Graph Neural Networks
2022/02/04 by Waleffe, Roger, Mohoney, Jason, Rekatsinas, Theodoros +1 · 1 citation
#Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Does compressing activations help model parallel training?
2023/01/06 by Song Bian, Bian, Song, Dacheng Li +7 · 1 citation
Computer Science · #Algorithms and Data Compression #Machine Learning and Data Classification #Generative Adversarial Networks and Image Synthesis
- Blox: A Modular Toolkit for Deep Learning Schedulers
2023/12/19 by Agarwal, Saurabh, Phanishayee, Amar, Venkataraman, Shivaram · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- PAL: A Variability-Aware Policy for Scheduling ML Workloads in GPU Clusters
2024/08/21 by Jain, Rutwik, Tran, Brandon, Chen, Keting +2 · 2 citations
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- GraphSnapShot: Caching Local Structure for Fast Graph Learning
2024/06/25 by Liu, Dong, Waleffe, Roger, Jiang, Meng +1 · 2 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Social and Information Networks (cs.SI) #and Cluster Computing (cs.DC)
- CHAI: Clustered Head Attention for Efficient LLM Inference
2024/03/12 by Saurabh Agarwal, Bilge Acun, Agarwal, Saurabh +12 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Eva: Cost-Efficient Cloud-Based Cluster Scheduling
2025/03/10 by Chang, Tzu-Tao, Venkataraman, Shivaram · 1 citation
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
- Quake: Adaptive Indexing for Vector Search
2025/06/03 by Jason Mohoney, Devesh Sarda, Mohoney, Jason +13 · 3 citations
Computer Science · #Advanced Database Systems and Queries #Data Management and Algorithms #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Information Retrieval and Search Behavior
- Mirage: Towards Low-interruption Services on Batch GPU Clusters with Reinforcement Learning
2023/06/25 by Ding, Qiyang, Zheng, Pengfei, Kudari, Shreyas +2 · 1 citation
#Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)