Chitty-Venkata, Krishna Teja
- LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators
2024/10/31 by Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Chitty-Venkata, Krishna Teja +15 · 12 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- A Survey of Techniques for Optimizing Transformer Inference
2023/07/16 by Chitty-Venkata, Krishna Teja, Mittal, Sparsh, Emani, Murali +2 · 6 citations
#Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
- PagedEviction: Structured Block-wise KV Cache Pruning for Efficient Large Language Model Inference
2025/09/04 by Chitty-Venkata, Krishna Teja, Ye, Jie, Sun, Xian-He +4 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- MoPEQ: Mixture of Mixed Precision Quantized Experts
2025/09/02 by Chitty-Venkata, Krishna Teja, Ye, Jie, Emani, Murali · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)