Elias Frantar
- SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
2023/01/02 by Elias Frantar, Dan Alistarh, Frantar, Elias +1 · 3 voices · 172 citations
Computer Science · Engineering · #Advanced Data Storage Technologies #Ferroelectric and Negative Capacitance Devices #Topic Modeling #cs.LG
- GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
2022/10/31 by Elias Frantar, Saleh Ashkboos, Frantar, Elias +5 · 278 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech Recognition and Synthesis #Topic Modeling
- QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models
2023/10/25 by Elias Frantar, Dan Alistarh, Frantar, Elias +1 · 3 voices · 4 citations
Computer Science · #Machine Learning and Algorithms #Speech Recognition and Synthesis #Topic Modeling #cs.LG
- SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
2023/06/05 by Tim Dettmers, Ruslan Svirschevski, Dettmers, Tim +15 · 1 voice · 33 citations
Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
- Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning
2022/08/24 by Elias Frantar, Frantar, Elias, Singh, Sidak Pal +1 · 35 citations
Computer Science · Medicine · #Advanced MRI Techniques and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Medical Image Segmentation Techniques #Medical Imaging Techniques and Applications
- Extreme Compression of Large Language Models via Additive Quantization
2024/01/11 by Vage Egiazarian, Egiazarian, Vage, Andrei Panferov +9 · 29 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models
2024/08/21 by Elias Frantar, Roberto L. Castro, Frantar, Elias +7 · 11 citations
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Natural Language Processing Techniques #Topic Modeling
- SPDY: Accurate Pruning with Speedup Guarantees
2022/01/31 by Elias Frantar, Frantar, Elias, Dan Alistarh +1 · 3 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Scaling Laws for Sparsely-Connected Foundation Models
2023/09/15 by Elias Frantar, Carlos Riquelme, Frantar, Elias +7 · 3 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models
2022/10/14 by Denis Kuznedelev, Kuznedelev, Denis, Eldar Kurtic +5 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Advanced Image and Video Retrieval Techniques
- M-FAC: Efficient Matrix-Free Approximations of Second-Order Information
2021/07/07 by Elias Frantar, Eldar Kurtic, Frantar, Elias +3 · 1 citation
Computer Science · Mathematics · Engineering · #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications #Sparse and Compressive Sensing Techniques
- Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression
2023/03/25 by Denis Kuznedelev, Kuznedelev, Denis, Soroush Tabesh +11 · 1 citation
Computer Science · #68T07 #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #I.m