vix.ing · top · new · best · stats · spec

Frantar, Elias

  1. SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
    2023/01/02 by Elias Frantar, Dan Alistarh, Frantar, Elias +1 · 3 voices · 175 citations
    Computer Science · Engineering · #Advanced Data Storage Technologies #Ferroelectric and Negative Capacitance Devices #Topic Modeling #cs.LG
  2. GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
    2022/10/31 by Elias Frantar, Saleh Ashkboos, Frantar, Elias +5 · 283 citations
    Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Speech Recognition and Synthesis #Topic Modeling
  3. QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models
    2023/10/25 by Elias Frantar, Frantar, Elias, Dan Alistarh +1 · 3 voices · 4 citations
    Computer Science · #Machine Learning and Algorithms #Speech Recognition and Synthesis #Topic Modeling #cs.LG
  4. SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression
    2023/06/05 by Tim Dettmers, Ruslan Svirschevski, Dettmers, Tim +15 · 1 voice · 35 citations
    Computer Science · Engineering · #Ferroelectric and Negative Capacitance Devices #Speech Recognition and Synthesis #Topic Modeling #cs.CL #cs.LG
  5. Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning
    2022/08/24 by Elias Frantar, Frantar, Elias, Singh, Sidak Pal +1 · 38 citations
    Computer Science · Medicine · #Advanced MRI Techniques and Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Medical Image Segmentation Techniques #Medical Imaging Techniques and Applications
  6. Extreme Compression of Large Language Models via Additive Quantization
    2024/01/11 by Vage Egiazarian, Andrei Panferov, Egiazarian, Vage +9 · 31 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  7. The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models
    2022/03/14 by Kurtic, Eldar, Campos, Daniel, Nguyen, Tuan +5 · 7 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  8. MARLIN: Mixed-Precision Auto-Regressive Parallel Inference on Large Language Models
    2024/08/21 by Elias Frantar, Roberto L. Castro, Frantar, Elias +7 · 11 citations
    Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Natural Language Processing Techniques #Topic Modeling
  9. QUIK: Towards End-to-End 4-Bit Inference on Generative Large Language Models
    2023/10/13 by Ashkboos, Saleh, Markov, Ilia, Frantar, Elias +5 · 9 citations
    #FOS: Computer and information sciences #Machine Learning (cs.LG)
  10. ZipLM: Inference-Aware Structured Pruning of Language Models
    2023/02/07 by Kurtic, Eldar, Frantar, Elias, Alistarh, Dan · 5 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  11. SPDY: Accurate Pruning with Speedup Guarantees
    2022/01/31 by Elias Frantar, Dan Alistarh, Frantar, Elias +1 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  12. Scaling Laws for Sparsely-Connected Foundation Models
    2023/09/15 by Elias Frantar, Frantar, Elias, Carlos Riquelme +7 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  13. CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models
    2022/10/14 by Denis Kuznedelev, Eldar Kurtic, Kuznedelev, Denis +5 · 2 citations
    Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Advanced Image and Video Retrieval Techniques
  14. Sparse Fine-tuning for Inference Acceleration of Large Language Models
    2023/10/10 by Kurtic, Eldar, Kuznedelev, Denis, Frantar, Elias +2 · 2 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
  15. M-FAC: Efficient Matrix-Free Approximations of Second-Order Information
    2021/07/07 by Elias Frantar, Eldar Kurtic, Frantar, Elias +3 · 1 citation
    Computer Science · Mathematics · Engineering · #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications #Sparse and Compressive Sensing Techniques
  16. Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression
    2023/03/25 by Denis Kuznedelev, Soroush Tabesh, Kuznedelev, Denis +11 · 1 citation
    Computer Science · #68T07 #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #I.m
  17. JaxPruner: A concise library for sparsity research
    2023/04/27 by Lee, Joo Hyung, Park, Wonpyo, Mitchell, Nicole +22 · 1 citation
    #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software Engineering (cs.SE)
  18. Compression Scaling Laws:Unifying Sparsity and Quantization
    2025/02/23 by Frantar, Elias, Evci, Utku, Park, Wonpyo +2 · 2 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)