Gholami, Amir
- SqueezeLLM: Dense-and-Sparse Quantization
2023/06/13 by Sehoon Kim, Coleman Hooper, Kim, Sehoon +13 · 3 voices · 29 citations
Computer Science · #cs.CL #cs.LG
- KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
2024/01/31 by Coleman Hooper, Hooper, Coleman, Sehoon Kim +11 · 1 voice · 85 citations
#cs.LG
- A Survey of Quantization Methods for Efficient Neural Network Inference
2021/03/25 by Amir Gholami, Sehoon Kim, Gholami, Amir +9 · 75 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Medical Image Segmentation Techniques #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge
2018/11/05 by Bakas, Spyridon, Reyes, Mauricio, Jakab, Andras +421 · 42 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- An LLM Compiler for Parallel Function Calling
2023/12/07 by Kim, Sehoon, Moon, Suhong, Tabrizi, Ryan +4 · 36 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- ZeroQ: A Novel Zero Shot Quantization Framework
2020/01/01 by Cai, Yaohui, Yao, Zhewei, Dong, Zhen +3 · 20 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Speculative Decoding with Big Little Decoder
2023/02/15 by Sehoon Kim, Karttikeya Mangalam, Kim, Sehoon +10 · 27 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- A Fast Post-Training Pruning Framework for Transformers
2022/03/29 by Woosuk Kwon, Sehoon Kim, Kwon, Woosuk +9 · 20 citations
Computer Science · #Advanced Neural Network Applications #Generative Adversarial Networks and Image Synthesis #Domain Adaptation and Few-Shot Learning
- ANODE: Unconditionally Accurate Memory-Efficient Gradients for Neural ODEs
2019/02/27 by Amir Gholami, Gholami, Amir, Kurt Keutzer +3 · 18 citations
Engineering · Physics and Astronomy · #Advanced Numerical Analysis Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks
- Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks
2025/03/12 by Lutfi Eren Erdogan, Erdogan, Lutfi Eren, Se Hoon Kim +11 · 54 citations
Computer Science · #AI-based Problem Solving and Planning #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- Learned Token Pruning for Transformers
2021/07/02 by Kim, Sehoon, Shen, Sheng, Thorsley, David +4 · 15 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- AI and Memory Wall
2024/03/21 by Amir Gholami, Gholami, Amir, Zhewei Yao +9 · 25 citations
Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Checkmate: Breaking the Memory Wall with Optimal Tensor Rematerialization
2019/10/07 by Paras Jain, Jain, Paras, Ajay N. Jain +13 · 9 citations
Computer Science · Mathematics · #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications
- Adaptive Self-supervision Algorithms for Physics-informed Neural Networks
2022/07/08 by Shashank Subramanian, Robert Kirby, Subramanian, Shashank +5 · 7 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Neural Networks and Reservoir Computing #Neural Networks and Applications
- Squeezed Attention: Accelerating Long Context Length LLM Inference
2024/11/14 by Coleman Hooper, Sehoon Kim, Hooper, Coleman +12 · 14 citations
Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Squeezeformer: An Efficient Transformer for Automatic Speech Recognition
2022/06/02 by Kim, Sehoon, Gholami, Amir, Shaw, Albert +5 · 6 citations
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Hessian-Aware Pruning and Optimal Neural Implant
2021/01/22 by Shixing Yu, Yu, Shixing, Zhewei Yao +10 · 5 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences
- On the Computational Inefficiency of Large Batch Sizes for Stochastic Gradient Descent
2018/11/30 by Noah Golmant, Golmant, Noah, Nikita Vemuri +13 · 5 citations
Computer Science · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- TinyAgent: Function Calling at the Edge
2024/09/01 by Lutfi Eren Erdogan, Erdogan, Lutfi Eren, Siddharth Jha +16 · 11 citations
Computer Science · #Computation and Language (cs.CL) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #Machine Learning (cs.LG)
- AccFFT: A library for distributed-memory FFT on CPU and GPU\n architectures
2015/06/25 by Amir Gholami, Gholami, Amir, Judith Hill +5 · 3 citations
Computer Science · Earth and Planetary Sciences · #Parallel Computing and Optimization Techniques #Distributed and Parallel Computing Systems #Seismic Imaging and Inversion Techniques
- LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
2024/03/22 by Thanakul Wattanawong, Lee, Nicholas, Wattanawong, Thanakul +13 · 7 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Large batch size training of neural networks with adversarial training and second-order information
2018/10/02 by Zhewei Yao, Amir Gholami, Yao, Zhewei +11 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- SPEED: Speculative Pipelined Execution for Efficient Decoding
2023/10/18 by Coleman Hooper, Hooper, Coleman, Sehoon Kim +11 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- ETS: Efficient Tree Search for Inference-Time Scaling
2025/02/19 by Hooper, Coleman, Kim, Sehoon, Moon, Suhong +7 · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient and Scalable Estimation of Tool Representations in Vector Space
2024/09/02 by Moon, Suhong, Jha, Siddharth, Erdogan, Lutfi Eren +4 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache
2025/02/05 by Haocheng Xi, Tiwari, Rishabh, Xi, Haocheng +16 · 6 citations
Computer Science · #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Cellular Automata and Applications #Error Correcting Code Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Characterizing Prompt Compression Methods for Long Context Inference
2024/07/11 by Siddharth Jha, Jha, Siddharth, Lutfi Eren Erdogan +7 · 2 citations
Computer Science · #Advanced Data Compression Techniques #Anomaly Detection Techniques and Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Time Series Analysis and Forecasting
- Multipole Attention for Efficient Long Context Reasoning
2025/06/16 by Coleman Hooper, Hooper, Coleman, Zhao, Sebastian +11 · 3 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Geophysical Methods and Applications #Indoor and Outdoor Localization Technologies #Machine Learning (cs.LG) #Speech Recognition and Synthesis
- End-to-end codesign of Hessian-aware quantized neural networks for FPGAs and ASICs
2023/04/13 by Campos, Javier, Dong, Zhen, Duarte, Javier +4 · 1 citation
#FOS: Computer and information sciences #FOS: Physical sciences #Hardware Architecture (cs.AR) #High Energy Physics - Experiment (hep-ex) #Instrumentation and Detectors (physics.ins-det) #Machine Learning (cs.LG)