Srivatsa, Vikranth
- Preble: Efficient Distributed Prompt Scheduling for LLM Serving
2024/05/08 by Vikranth Srivatsa, Srivatsa, Vikranth, Zijian He +7 · 22 citations
Computer Science · #Distributed #Distributed and Parallel Computing Systems #Distributed systems and fault tolerance #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Petri Nets in System Modeling #and Cluster Computing (cs.DC)
- InferCept: Efficient Intercept Support for Augmented Large Language Model Inference
2024/02/02 by Reyna Abhyankar, Zijian He, Abhyankar, Reyna +7 · 8 citations
Business, Management and Accounting · Computer Science · #Business Process Modeling and Analysis #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Semantic Web and Ontologies #and Cluster Computing (cs.DC)
- Cognify: Supercharging Gen-AI Workflows With Hierarchical Autotuning
2025/02/12 by Zijian He, Reyna Abhyankar, He, Zijian +5 · 6 citations
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multiagent Systems (cs.MA) #Scientific Computing and Data Management