Tijmen Blankevoort
- Up or Down? Adaptive Rounding for Post-Training Quantization
2020/04/22 by Markus Nagel, Rana Ali Amjad, Nagel, Markus +7 · 59 citations
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Domain Adaptation and Few-Shot Learning
- SpinQuant: LLM quantization with learned rotations
2024/05/26 by Zechun Liu, Changsheng Zhao, Liu, Zechun +15 · 85 citations
Computer Science · #Advanced Data Compression Techniques #Algorithms and Data Compression
- VeRA: Vector-based Random Matrix Adaptation
2023/10/17 by Dawid Jan Kopiczko, Kopiczko, Dawid J., Tijmen Blankevoort +3 · 45 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Speech Recognition and Synthesis #Topic Modeling
- LSQ+: Improving low-bit quantization through learnable offsets and better initialization
2020/04/20 by Yash Bhalgat, Bhalgat, Yash, Jinwon Lee +7 · 20 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning
- Overcoming Oscillations in Quantization-Aware Training
2022/03/21 by Markus Nagel, Marios Fournarakis, Nagel, Markus +5 · 17 citations
Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Image Enhancement Techniques #Machine Learning (cs.LG)
- FP8 Quantization: The Power of the Exponent
2022/08/19 by Andrey N. Kuzmin, Kuzmin, Andrey, Mart van Baalen +9 · 12 citations
Computer Science · Physics and Astronomy · #Neural Networks and Applications #Model Reduction and Neural Networks #Advanced Neural Network Applications
- Llama Guard 3-1B-INT4: Compact and Efficient Safeguard for Human-AI Conversations
2024/11/18 by Igor Fedorov, Fedorov, Igor, Kate Plawiak +37 · 2 voices · 5 citations
#cs.DC #cs.AI
- Pruning vs Quantization: Which is Better?
2023/07/06 by Andrey N. Kuzmin, Kuzmin, Andrey, Markus Nagel +7 · 10 citations
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural Networks and Applications
- GPTVQ: The Blessing of Dimensionality for LLM Quantization
2024/02/23 by Mart van Baalen, Andrey N. Kuzmin, van Baalen, Mart +14 · 11 citations
Computer Science · Decision Sciences · Physics and Astronomy · #Distributed and Parallel Computing Systems #Scientific Computing and Data Management #Atomic and Subatomic Physics Research
- Bayesian Bits: Unifying Quantization and Pruning
2020/05/14 by Mart van Baalen, Christos Louizos, van Baalen, Mart +11 · 5 citations
Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- MSViT: Dynamic Mixed-Scale Tokenization for Vision Transformers
2023/07/05 by Jakob D. Havtorn, Havtorn, Jakob Drachmann, Amélie Royer +5 · 5 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · #Advanced Neural Network Applications #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing Techniques and Applications
- Neural Network Quantization with AI Model Efficiency Toolkit (AIMET)
2022/01/20 by Sangeetha Siddegowda, Marios Fournarakis, Siddegowda, Sangeetha +9 · 3 citations
Computer Science · Engineering · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Fault Detection and Control Systems #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Neural Networks and Applications #Performance (cs.PF) #Software Engineering (cs.SE)
- Think Big, Generate Quick: LLM-to-SLM for Fast Autoregressive Decoding
2024/02/26 by Benjamin Bergner, Andrii Skliar, Bergner, Benjamin +9 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- Scalarization for Multi-Task and Multi-Domain Learning at Scale
2023/10/13 by Amélie Royer, Tijmen Blankevoort, Royer, Amelie +3 · 4 citations
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and ELM #Seismology and Earthquake Studies
- Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces
2020/12/16 by Bert Moons, Moons, Bert, Parham Noorzad +11 · 2 citations
Computer Science · Neuroscience · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Brain Tumor Detection and Classification #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural and Evolutionary Computing (cs.NE)
- Learned Threshold Pruning
2020/02/28 by Kambiz Azarian, Azarian, Kambiz, Yash Bhalgat +5 · 3 citations
Computer Science · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Video Analysis and Summarization
- Revisiting Single-gated Mixtures of Experts
2023/04/11 by Amélie Royer, Royer, Amelie, Ilia Karmanov +7 · 2 citations
Computer Science · Medicine · #Domain Adaptation and Few-Shot Learning #Machine Learning and Algorithms #SARS-CoV-2 detection and testing
- ParetoQ: Improving Scaling Laws in Extremely Low-bit LLM Quantization
2025/02/04 by Zechun Liu, Liu, Zechun, Changsheng Zhao +28 · 5 citations
Physics and Astronomy · Computer Science · #Particle Detector Development and Performance #Atomic and Subatomic Physics Research #Advanced Data Compression Techniques
- Efficient Neural PDE-Solvers using Quantization Aware Training
2023/08/14 by Winfried van den Dool, Dool, Winfried van den, Tijmen Blankevoort +5 · 2 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Neural Networks and Applications #Neural Networks and Reservoir Computing
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
2025/12/23 by NVIDIA, :, Aaron Blakeman +623 · 1 voice · 2 citations
#cs.CL #cs.AI #cs.LG
- A Practical Mixed Precision Algorithm for Post-Training Quantization
2023/02/10 by Nilesh Prasad Pandey, Pandey, Nilesh Prasad, Markus Nagel +9 · 1 citation
Computer Science · #Advanced Neural Network Applications #Advanced Image and Video Retrieval Techniques #Neural Networks and Applications
- Batch-Shaping for Learning Conditional Channel Gated Networks
2019/07/15 by Babak Ehteshami Bejnordi, Tijmen Blankevoort, Bejnordi, Babak Ehteshami +3 · 1 citation
Computer Science · #Advanced Neural Network Applications #Adversarial Robustness in Machine Learning #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification
- SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales
2026/07/13 by Mikail Khona, Aditya Vavre, Boxiang Wang +11
#cs.LG #cs.AI