Goel, Raghavv
- On Speculative Decoding for Multimodal Large Language Models
2024/04/13 by Mukul Gagrani, Gagrani, Mukul, Raghavv Goel +9 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- KeyDiff: Key Similarity-Based KV Cache Eviction for Long-Context LLM Inference in Resource-Constrained Environments
2025/04/21 by Park, Junyoung, Jones, Dalton, Morse, Matthew J +3 · 11 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences
- Recursive Speculative Decoding: Accelerating LLM Inference via Sampling Without Replacement
2024/02/21 by Jeon, Wonseok, Gagrani, Mukul, Goel, Raghavv +3 · 4 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- CAOTE: KV Cache Selection for LLMs via Attention Output Error-Based Token Eviction
2025/04/18 by Raghavv Goel, Junyoung Park, Goel, Raghavv +13 · 1 voice
Computer Science · #Advanced Data Storage Technologies #Computation and Language (cs.CL) #Distributed and Parallel Computing Systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization #cs.CL #cs.LG
- Direct Alignment of Draft Model for Speculative Decoding with Chat-Fine-Tuned LLMs
2024/02/29 by Goel, Raghavv, Gagrani, Mukul, Jeon, Wonseok +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- VOCABTRIM: Vocabulary Pruning for Efficient Speculative Decoding in LLMs
2025/06/28 by Raghavv Goel, Goel, Raghavv, Mukul Gagrani +19 · 4 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- Structuring The Future: Diffusion LLM Speculative Decoding via Calibrated Draft Graphs
2025/09/22 by Risheek Garrepalli, Agrawal, Sudhanshu, Raghavv Goel +7 · 5 citations
Computer Science · #Neural Networks and Applications