Jayashree Mohan
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
2024/03/04 by Amey Agrawal, Agrawal, Amey, Nitin Kedia +13 · 121 citations
Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
- SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills
2023/08/31 by Amey Agrawal, Ashish Panwar, Agrawal, Amey +9 · 41 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Vidur: A Large-Scale Simulation Framework For LLM Inference
2024/05/08 by Amey Agrawal, Nitin Kedia, Agrawal, Amey +13 · 24 citations
Decision Sciences · #Simulation Techniques and Applications
- vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention
2024/05/07 by Ramya Prabhu, A.K. Nayak, Prabhu, Ramya +7 · 23 citations
Computer Science · #Advanced Data Storage Technologies #Cryptography and Data Security #FOS: Computer and information sciences #Machine Learning (cs.LG) #Operating Systems (cs.OS) #Security and Verification in Computing
- Analyzing IO Amplification in Linux File Systems
2017/07/26 by Jayashree Mohan, Mohan, Jayashree, Rohan Kadekodi +3 · 1 voice · 2 citations
Computer Science · #Advanced Data Storage Technologies #Distributed systems and fault tolerance #FOS: Computer and information sciences #Operating Systems (cs.OS) #Parallel Computing and Optimization Techniques #cs.OS
- ModServe: Modality- and Stage-Aware Resource Disaggregation for Scalable Multimodal Model Serving
2025/02/02 by Qiu, Haoran, Biswas, Anish, Zihan Zhao +19 · 6 citations
Computer Science · Engineering · #Advanced Computational Techniques and Applications #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #Power Systems and Technologies #Speech and dialogue systems #and Cluster Computing (cs.DC)
- Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
2024/07/09 by Amey Agrawal, Anmol Agarwal, Agrawal, Amey +13 · 3 citations
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #Data Quality and Management #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Semantic Web and Ontologies #and Cluster Computing (cs.DC)
- Niyama : Breaking the Silos of LLM Inference Serving
2025/03/28 by Jayashree Mohan, Goel, Kanishk, Nipun Kwatra +6 · 3 citations
Computer Science · #Software-Defined Networks and 5G #Software System Performance and Reliability #Cloud Computing and Resource Management
- On Evaluating Performance of LLM Inference Serving Systems
2025/07/11 by Amey Agrawal, Nitin Kedia, Agrawal, Amey +13 · 3 citations
Computer Science · #Service-Oriented Architecture and Web Services #Distributed and Parallel Computing Systems