Kurtic, Eldar
- The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models
2022/03/14 by Kurtic, Eldar, Campos, Daniel, Nguyen, Tuan +5 · 7 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- ZipLM: Inference-Aware Structured Pruning of Language Models
2023/02/07 by Kurtic, Eldar, Frantar, Elias, Alistarh, Dan · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- CAP: Correlation-Aware Pruning for Highly-Accurate Sparse Vision Models
2022/10/14 by Denis Kuznedelev, Kuznedelev, Denis, Eldar Kurtic +5 · 2 citations
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Advanced Image and Video Retrieval Techniques
- "Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
2024/11/04 by Eldar Kurtic, Kurtic, Eldar, Alexandre Carriconde Marques +7 · 5 citations
Engineering · Computer Science · #Reservoir Engineering and Simulation Methods #Distributed and Parallel Computing Systems
- MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
2024/05/24 by Modoranu, Ionut-Vlad, Safaryan, Mher, Malinovsky, Grigory +4 · 3 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Numerical Analysis (math.NA)
- Sparse Fine-tuning for Inference Acceleration of Large Language Models
2023/10/10 by Kurtic, Eldar, Kuznedelev, Denis, Frantar, Elias +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment
2024/05/06 by Abhinav Agarwalla, Agarwalla, Abhinav, Abhay Gupta +21 · 2 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computational Geometry and Mesh Generation #Dynamics and Control of Mechanical Systems #FOS: Computer and information sciences #Robotic Mechanisms and Dynamics
- M-FAC: Efficient Matrix-Free Approximations of Second-Order Information
2021/07/07 by Elias Frantar, Eldar Kurtic, Frantar, Elias +3 · 1 citation
Computer Science · Mathematics · Engineering · #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications #Sparse and Compressive Sensing Techniques
- EvoPress: Accurate Dynamic Model Compression via Evolutionary Search
2024/10/18 by Oliver Sieberling, Denis Kuznedelev, Sieberling, Oliver +5 · 2 citations
Computer Science · #Evolutionary Algorithms and Applications #Reinforcement Learning in Robotics
- GMP*: Well-Tuned Gradual Magnitude Pruning Can Outperform Most BERT-Pruning Methods
2022/10/12 by Eldar Kurtic, Kurtic, Eldar, Dan Alistarh +1 · 1 citation
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- Vision Models Can Be Efficiently Specialized via Few-Shot Task-Aware Compression
2023/03/25 by Denis Kuznedelev, Soroush Tabesh, Kuznedelev, Denis +11 · 1 citation
Computer Science · #68T07 #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #I.m
- DarwinLM: Evolutionary Structured Pruning of Large Language Models
2025/02/11 by Shengkun Tang, Oliver Sieberling, Tang, Shengkun +7 · 3 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling
- Mathador-LM: A Dynamic Benchmark for Mathematical Reasoning on Large Language Models
2024/06/18 by Eldar Kurtic, Kurtic, Eldar, Amir Moeini +3 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling