Nitin Kedia

1. Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve
   2024/03/04 by Amey Agrawal, Agrawal, Amey, Nitin Kedia +13 · 113 citations
   Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #and Cluster Computing (cs.DC)
2. Vidur: A Large-Scale Simulation Framework For LLM Inference
   2024/05/08 by Amey Agrawal, Agrawal, Amey, Nitin Kedia +13 · 24 citations
   Decision Sciences · #Simulation Techniques and Applications
3. Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
   2024/07/09 by Amey Agrawal, Agrawal, Amey, Anmol Agarwal +13 · 2 citations
   Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Data Mining Algorithms and Applications #Data Quality and Management #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Semantic Web and Ontologies #and Cluster Computing (cs.DC)
4. On Evaluating Performance of LLM Inference Serving Systems
   2025/07/11 by Amey Agrawal, Agrawal, Amey, Nitin Kedia +13 · 3 citations
   Computer Science · #Service-Oriented Architecture and Web Services #Distributed and Parallel Computing Systems