Sehoon Kim
- SqueezeLLM: Dense-and-Sparse Quantization
2023/06/13 by Sehoon Kim, Kim, Sehoon, Coleman Hooper +13 · 3 voices · 29 citations
Computer Science · #cs.CL #cs.LG
- KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
2024/01/31 by Coleman Hooper, Sehoon Kim, Hooper, Coleman +11 · 1 voice · 85 citations
#cs.LG
- A Survey of Quantization Methods for Efficient Neural Network Inference
2021/03/25 by Amir Gholami, Gholami, Amir, Sehoon Kim +9 · 75 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Medical Image Segmentation Techniques #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Applications and Techniques for Fast Machine Learning in Science
2021/10/25 by A. M. Deiana, Allison McCarn Deiana, Nhan Tran +111 · 1 voice · 2 citations
Decision Sciences · Computer Science · #Scientific Computing and Data Management #Neural Networks and Reservoir Computing #Anomaly Detection Techniques and Applications
- Speculative Decoding with Big Little Decoder
2023/02/15 by Sehoon Kim, Kim, Sehoon, Karttikeya Mangalam +10 · 27 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- A Fast Post-Training Pruning Framework for Transformers
2022/03/29 by Woosuk Kwon, Sehoon Kim, Kwon, Woosuk +9 · 20 citations
Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning
- AI and Memory Wall
2024/03/21 by Amir Gholami, Gholami, Amir, Zhewei Yao +9 · 25 citations
Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Squeezed Attention: Accelerating Long Context Length LLM Inference
2024/11/14 by Coleman Hooper, Hooper, Coleman, Sehoon Kim +12 · 14 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
2024/03/22 by Lee, Nicholas, Thanakul Wattanawong, Sehoon Kim +13 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- SPEED: Speculative Pipelined Execution for Efficient Decoding
2023/10/18 by Coleman Hooper, Sehoon Kim, Hooper, Coleman +11 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache
2025/02/05 by Tiwari, Rishabh, Haocheng Xi, Aditya Tomar +16 · 6 citations
Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Cellular Automata and Applications #Error Correcting Code Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Characterizing Prompt Compression Methods for Long Context Inference
2024/07/11 by Siddharth Jha, Lutfi Eren Erdogan, Jha, Siddharth +7 · 2 citations
Computer Science · #Advanced Data Compression Techniques #Anomaly Detection Techniques and Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- Multipole Attention for Efficient Long Context Reasoning
2025/06/16 by Coleman Hooper, Hooper, Coleman, Zhao, Sebastian +11 · 3 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Geophysical Methods and Applications #Indoor and Outdoor Localization Technologies #Machine Learning (cs.LG) #Speech Recognition and Synthesis