Blankevoort, Tijmen
- Up or Down? Adaptive Rounding for Post-Training Quantization
2020/04/22 by Markus Nagel, Rana Ali Amjad, Nagel, Markus +7 · 60 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- A White Paper on Neural Network Quantization
2021/06/15 by Nagel, Markus, Fournarakis, Marios, Amjad, Rana Ali +3 · 57 citations
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- SpinQuant: LLM quantization with learned rotations
2024/05/26 by Zechun Liu, Changsheng Zhao, Liu, Zechun +15 · 87 citations
Computer Science · #Advanced Data Compression Techniques #Algorithms and Data Compression
- VeRA: Vector-based Random Matrix Adaptation
2023/10/17 by Dawid Jan Kopiczko, Tijmen Blankevoort, Kopiczko, Dawid J. +3 · 45 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Speech Recognition and Synthesis #Topic Modeling
- LSQ+: Improving low-bit quantization through learnable offsets and better initialization
2020/04/20 by Yash Bhalgat, Jinwon Lee, Bhalgat, Yash +7 · 20 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning
- Overcoming Oscillations in Quantization-Aware Training
2022/03/21 by Markus Nagel, Nagel, Markus, Marios Fournarakis +5 · 17 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Image Enhancement Techniques #Machine Learning (cs.LG)
- Quantizable Transformers: Removing Outliers by Helping Attention Heads Do Nothing
2023/06/22 by Bondarenko, Yelysei, Nagel, Markus, Blankevoort, Tijmen · 15 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Understanding and Overcoming the Challenges of Efficient Transformer Quantization
2021/09/27 by Bondarenko, Yelysei, Nagel, Markus, Blankevoort, Tijmen · 10 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- FP8 Quantization: The Power of the Exponent
2022/08/19 by Andrey N. Kuzmin, Kuzmin, Andrey, Mart van Baalen +9 · 12 citations
Computer Science · Physics and Astronomy · #Neural Networks and Applications #Model Reduction and Neural Networks #Advanced Neural Network Applications
- Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations
2024/11/18 by Igor Fedorov, Fedorov, Igor, Kate Plawiak +37 · 2 voices · 5 citations
#cs.DC #cs.AI
- Pruning vs Quantization: Which is Better?
2023/07/06 by Andrey N. Kuzmin, Markus Nagel, Kuzmin, Andrey +7 · 10 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural Networks and Applications
- GPTVQ: The Blessing of Dimensionality for LLM Quantization
2024/02/23 by Mart van Baalen, Andrey N. Kuzmin, van Baalen, Mart +14 · 11 citations
Computer Science · Decision Sciences · Physics and Astronomy · #Distributed and Parallel Computing Systems #Scientific Computing and Data Management #Atomic and Subatomic Physics Research
- Differentiable Joint Pruning and Quantization for Hardware Efficiency
2020/07/20 by Wang, Ying, Lu, Yadong, Blankevoort, Tijmen · 5 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Bayesian Bits: Unifying Quantization and Pruning
2020/05/14 by Mart van Baalen, Christos Louizos, van Baalen, Mart +11 · 5 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- MSViT: Dynamic Mixed-Scale Tokenization for Vision Transformers
2023/07/05 by Jakob D. Havtorn, Amélie Royer, Havtorn, Jakob Drachmann +5 · 5 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Advanced Neural Network Applications #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications
- Neural Network Quantization with AI Model Efficiency Toolkit (AIMET)
2022/01/20 by Sangeetha Siddegowda, Siddegowda, Sangeetha, Marios Fournarakis +9 · 3 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Fault Detection and Control Systems #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Neural Networks and Applications #Performance (cs.PF) #Software Engineering (cs.SE)
- Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding
2024/02/26 by Benjamin Bergner, Bergner, Benjamin, Andrii Skliar +9 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- Scalarization for Multi-Task and Multi-Domain Learning at Scale
2023/10/13 by Amélie Royer, Royer, Amelie, Tijmen Blankevoort +3 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Seismology and Earthquake Studies
- FP8 versus INT8 for efficient deep learning inference
2023/03/31 by van Baalen, Mart, Kuzmin, Andrey, Nair, Suparna S +8 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Conditional Channel Gated Networks for Task-Aware Continual Learning
2020/03/31 by Abati, Davide, Tomczak, Jakub, Blankevoort, Tijmen +3 · 2 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces
2020/12/16 by Bert Moons, Parham Noorzad, Moons, Bert +11 · 2 citations
Computer Science · Neuroscience · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural and Evolutionary Computing (cs.NE)
- The LLM Surgeon
2023/12/28 by van der Ouderaa, Tycho F. A., Nagel, Markus, van Baalen, Mart +2 · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Learned Threshold Pruning
2020/02/28 by Kambiz Azarian, Azarian, Kambiz, Yash Bhalgat +5 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Video Analysis and Summarization
- Revisiting Single-gated Mixtures of Experts
2023/04/11 by Amélie Royer, Ilia Karmanov, Royer, Amelie +7 · 2 citations
Computer Science · Medicine · #Domain Adaptation and Few-Shot Learning #Machine Learning and Algorithms #SARS-CoV-2 detection and testing
- ParetoQ: Improving Scaling Laws in Extremely Low-bit LLM Quantization
2025/02/04 by Zechun Liu, Changsheng Zhao, Liu, Zechun +28 · 5 citations
Physics and Astronomy · Computer Science · #Particle Detector Development and Performance #Atomic and Subatomic Physics Research #Advanced Data Compression Techniques
- NVIDIA Nemotron 3: Efficient and Open Intelligence
2025/12/24 by NVIDIA, :, Blakeman, Aaron +356 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Cyclical Pruning for Sparse Neural Networks
2022/02/02 by Srinivas, Suraj, Kuzmin, Andrey, Nagel, Markus +3 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Efficient Neural PDE-Solvers using Quantization Aware Training
2023/08/14 by Winfried van den Dool, Dool, Winfried van den, Tijmen Blankevoort +5 · 2 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Neural Networks and Applications #Neural Networks and Reservoir Computing
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
2025/12/23 by NVIDIA, Aaron Blakeman, : +623 · 1 voice · 2 citations
#cs.CL #cs.AI #cs.LG
- A Practical Mixed Precision Algorithm for Post-Training Quantization
2023/02/10 by Nilesh Prasad Pandey, Pandey, Nilesh Prasad, Markus Nagel +9 · 1 citation
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Neural Networks and Applications
- Batch-Shaping for Learning Conditional Channel Gated Networks
2019/07/15 by Babak Ehteshami Bejnordi, Bejnordi, Babak Ehteshami, Tijmen Blankevoort +3 · 1 citation
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- QBitOpt: Fast and Accurate Bitwidth Reallocation during Training
2023/07/10 by Peters, Jorn, Fournarakis, Marios, Nagel, Markus +2 · 1 citation
#Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- InterroGate: Learning to Share, Specialize, and Prune Representations for Multi-task Learning
2024/02/26 by Bejnordi, Babak Ehteshami, Kumar, Gaurav, Royer, Amelie +3 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)