Rybakov, Oleg
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
2025/04/04 by NVIDIA, :, Blakeman, Aaron +198 · 26 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition
2023/02/02 by Yucheng Lu, Shivani Agrawal, Lu, Yucheng +9 · 3 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications
- NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model
2025/08/20 by NVIDIA, Aarti Basant, : +305 · 23 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
- Real-time Speech Frequency Bandwidth Extension
2020/10/21 by Li, Yunpeng, Tagliasacchi, Marco, Rybakov, Oleg +2 · 2 citations
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Pretraining Large Language Models with NVFP4
2025/09/29 by NVIDIA, Abecassis, Felix, Agrusa, Anjulie +86 · 11 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- 4-bit Conformer with Native Quantization Aware Training for Speech Recognition
2022/03/29 by Ding, Shaojin, Meadowlark, Phoenix, He, Yanzhang +3 · 1 citation
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #electronic engineering #information engineering
- Methods of improving LLM training stability
2024/10/22 by Rybakov, Oleg, Chrzanowski, Mike, Dykas, Peter +2 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- 2-bit Conformer quantization for automatic speech recognition
2023/05/26 by Rybakov, Oleg, Meadowlark, Phoenix, Ding, Shaojin +4 · 1 citation
#Audio and Speech Processing (eess.AS) #FOS: Electrical engineering #electronic engineering #information engineering