vix.ing · top · new · best · stats · spec

Bryan Catanzaro

  1. Deep Speech: Scaling up end-to-end speech recognition
    2014/12/17 by Awni Hannun, Hannun, Awni, Carl Case +19 · 4 voices · 17 citations
    #cs.CL #cs.LG #cs.NE
  2. Deep Speech 2: End-to-End Speech Recognition in English and Mandarin
    2015/12/08 by Dario Amodei, Rishita Anubhai, Amodei, Dario +66 · 1 voice · 65 citations
    Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #cs.CL
  3. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
    2019/09/17 by Mohammad Shoeybi, Mostofa Patwary, Shoeybi, Mohammad +9 · 329 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  4. Image Inpainting for Irregular Holes Using Partial Convolutions
    2018/04/20 by Guilin Liu, Fitsum A. Reda, Liu, Guilin +9 · 2 voices · 26 citations
    Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.CV
  5. ChipNeMo: Domain-Adapted LLMs for Chip Design
    2023/10/31 by Mingjie Liu, Teodor-Dumitru Ene, Liu, Mingjie +83 · 2 voices · 34 citations
    Computer Science · #Digital Rights Management and Security
  6. An Empirical Study of Mamba-based Language Models
    2024/06/12 by Roger Waleffe, Waleffe, Roger, Wonmin Byeon +30 · 1 voice · 46 citations
    Arts and Humanities · #Language, Linguistics, Cultural Analysis #cs.CL #cs.LG
  7. NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models
    2024/05/27 by Chankyu Lee, Rajarshi Roy, Lee, Chankyu +12 · 2 voices · 111 citations
    Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Natural Language Processing Techniques #cs.AI #cs.CL #cs.IR #cs.LG
  8. Efficient Large-Scale Language Model Training on GPU Clusters Using\n Megatron-LM
    2021/04/09 by Deepak Narayanan, Mohammad Shoeybi, Narayanan, Deepak +21 · 110 citations
    Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
  9. High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
    2017/11/30 by Ting-Chun Wang, Wang, Ting-Chun, Ming-Yu Liu +9 · 51 citations
    Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #Digital Media Forensic Detection #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Machine Learning (cs.LG)
  10. BigVGAN: A Universal Neural Vocoder with Large-Scale Training
    2022/06/09 by Sang-gil Lee, Lee, Sang-gil, Ping, Wei +6 · 70 citations
    Computer Science · Engineering · #Speech and Audio Processing #Music and Audio Processing #Acoustic Wave Phenomena Research
  11. Reducing Activation Recomputation in Large Transformer Models
    2022/05/10 by Vijay Anand Korthikanti, Korthikanti, Vijay, Jared Casper +11 · 58 citations
    Computer Science · #Advanced Neural Network Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Topic Modeling
  12. eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoisers
    2022/11/02 by Yogesh Balaji, Balaji, Yogesh, Seungjun Nah +22 · 63 citations
    Computer Science · #Generative Adversarial Networks and Image Synthesis
  13. Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers
    2021/11/24 by John Guibas, Guibas, John, Morteza Mardani +9 · 33 citations
    Engineering · Computer Science · #CCD and CMOS Imaging Sensors #Advanced Neural Network Applications #Advanced Memory and Neural Computing
  14. Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities
    2024/02/02 by Zhifeng Kong, Arushi Goel, Kong, Zhifeng +8 · 44 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
  15. Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
    2022/01/28 by Shaden Smith, Mostofa Patwary, Smith, Shaden +36 · 26 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  16. RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs
    2024/07/02 by Yue Yu, Yu, Yue, Wei Ping +13 · 46 citations
    Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Data Mining Algorithms and Applications
  17. Pretraining Large Language Models with NVFP4
    2025/09/29 by NVIDIA, Felix Abecassis, Abecassis, Felix +175 · 4 voices · 13 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
  18. Video-to-Video Synthesis
    2018/08/20 by Ting-Chun Wang, Ming-Yu Liu, Wang, Ting-Chun +11 · 23 citations
    Computer Science · #Advanced Image Processing Techniques #Advanced Vision and Imaging #Computer Graphics and Visualization Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Graphics (cs.GR) #Machine Learning (cs.LG)
  19. Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset
    2024/12/03 by Dan Su, Kezhi Kong, Su, Dan +15 · 50 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Natural Language Processing Techniques #Semantic Web and Ontologies
  20. Factuality Enhanced Language Models for Open-Ended Text Generation
    2022/06/09 by Nayeon Lee, Lee, Nayeon, Ping, Wei +9 · 20 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computers and Society (cs.CY) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering Research #Topic Modeling
  21. RADIOv2.5: Improved Baselines for Agglomerative Vision Foundation Models
    2024/12/10 by Greg Heinrich, Mike Ranzinger, Heinrich, Greg +14 · 34 citations
    Engineering · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Satellite Image Processing and Photogrammetry
  22. Compact Language Models via Pruning and Knowledge Distillation
    2024/07/19 by Saurav Muralidharan, Muralidharan, Saurav, Sharath Turuvekere Sreenivas +15 · 27 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
  23. Hierarchical Multi-Scale Attention for Semantic Segmentation
    2020/05/21 by Andrew Tao, Karan Sapra, Tao, Andrew +3 · 18 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #Advanced Image and Video Retrieval Techniques
  24. ChatQA: Surpassing GPT-4 on Conversational QA and RAG
    2024/01/18 by Zihan Liu, Liu, Zihan, Rajarshi Roy +9 · 15 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  25. AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling
    2024/12/19 by Zihan Liu, Yang Chen, Liu, Zihan +7 · 26 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Intelligent Tutoring Systems and Adaptive Learning #Machine Learning (cs.LG)
  26. NVLM: Open Frontier-Class Multimodal LLMs
    2024/09/17 by Wei‐Min Dai, Dai, Wenliang, Nayeon Lee +17 · 19 citations
    Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #Natural Language Processing Techniques #Semantic Web and Ontologies #Translation Studies and Practices
  27. Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models
    2023/05/17 by Songwei Ge, Seungjun Nah, Ge, Songwei +17 · 11 citations
    Computer Science · #Advanced Vision and Imaging #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Graphics (cs.GR) #Human Pose and Action Recognition #Machine Learning (cs.LG)
  28. Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders
    2024/08/28 by Min Shi, Shi, Min, Fuxiao Liu +28 · 18 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model-Driven Software Engineering Techniques #Robotics (cs.RO)
  29. AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning
    2025/05/22 by Yang Chen, Zhuolin Yang, Chen, Yang +13 · 32 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics #Topic Modeling
  30. Long-Short Transformer: Efficient Transformers for Language and Vision
    2021/07/05 by Chen Zhu, Wei Ping, Zhu, Chen +11 · 8 citations
    Computer Science · #Multimodal Machine Learning Applications #Topic Modeling #Domain Adaptation and Few-Shot Learning
  31. Nemotron-4 15B Technical Report
    2024/02/26 by Jupinder Parmar, Shrimai Prabhumoye, Parmar, Jupinder +51 · 1 voice · 3 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
  32. Upcycling Large Language Models into Mixture of Experts
    2024/10/10 by Ethan He, Abhinav Khattar, He, Ethan +17 · 14 citations
    Computer Science · #Expert finding and Q&A systems #Topic Modeling
  33. Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Models
    2025/01/20 by Zhiqi Li, Li, Zhiqi, Chen, Guo +50 · 16 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  34. Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis
    2020/05/12 by Rafael Valle, Kevin J. Shih, Valle, Rafael +5 · 7 citations
    Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Topic Modeling
  35. Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning
    2023/02/09 by Zhuolin Yang, Yang, Zhuolin, Ping, Wei +28 · 6 citations
    Computer Science · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
  36. AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy
    2025/06/16 by Zihan Liu, Liu, Zihan, Zhuolin Yang +11 · 32 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Teaching and Learning Programming
  37. Nemotron-Research-Tool-N1: Exploring Tool-Using Language Models with Reinforced Reasoning
    2025/04/25 by Shaokun Zhang, Yi Dong, Zhang, Shaokun +15 · 18 citations
    Computer Science · #Natural Language Processing Techniques #Text Readability and Simplification #Topic Modeling
  38. DSD: Dense-Sparse-Dense Training for Deep Neural Networks
    2016/07/15 by Song Han, Han, Song, Jeff Pool +21 · 5 citations
    Computer Science · #Advanced Neural Network Applications #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning and Algorithms
  39. One TTS Alignment To Rule Them All
    2021/08/23 by Rohan Badlani, Adrian Łancucki, Badlani, Rohan +8 · 4 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #Topic Modeling #electronic engineering #information engineering
  40. Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
    2023/04/13 by Boxin Wang, Wang, Boxin, Peng Xu +20 · 5 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
  41. Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Models
    2024/07/09 by Jupinder Parmar, Parmar, Jupinder, Sanjev Satheesh +7 · 8 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
  42. Large Scale Language Modeling: Converging on 40GB of Text in Four Hours
    2018/08/03 by Raul Puri, Robert M. Kirby, Puri, Raul +5 · 4 citations
    Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
  43. RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models
    2023/08/15 by Jie Huang, Huang, Jie, Ping, Wei +8 · 4 citations
    Computer Science · #Topic Modeling #Multimodal Machine Learning Applications #Natural Language Processing Techniques
  44. Improving Semantic Segmentation via Video Propagation and Label Relaxation
    2018/12/04 by Yi Zhu, Zhu, Yi, Karan Sapra +11 · 3 citations
    Computer Science · #Advanced Neural Network Applications #Multimodal Machine Learning Applications #Domain Adaptation and Few-Shot Learning
  45. Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase Pretraining
    2024/12/18 by Feng, Steven, Shrimai Prabhumoye, Kezhi Kong +10 · 9 citations
    Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG) #Machine Learning and Data Classification #Neural Networks and Applications
  46. NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model
    2025/08/20 by NVIDIA, :, Aarti Basant +305 · 24 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
  47. Zero-shot Text Classification With Generative Language Models
    2019/12/10 by Raul Puri, Puri, Raul, Bryan Catanzaro +1 · 4 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
  48. Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning
    2025/05/26 by Jaehun Jung, Jung, Jaehun, Seungju Han +17 · 10 citations
    Engineering · #Reservoir Engineering and Simulation Methods
  49. Speech Denoising in the Waveform Domain with Self-Attention
    2022/02/15 by Zhifeng Kong, Kong, Zhifeng, Ambrish Dantrey +4 · 2 citations
    Computer Science · #Advanced Data Compression Techniques #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
  50. Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models
    2022/02/08 by Boxin Wang, Wang, Boxin, Chaowei Xiao +14 · 2 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Adversarial Robustness in Machine Learning
  51. MIND: Math Informed syNthetic Dialogues for Pretraining LLMs
    2024/10/15 by Syeda Nahida Akter, Shrimai Prabhumoye, Akter, Syeda Nahida +13 · 4 citations
    Computer Science · #Natural Language Processing Techniques #Mathematics, Computing, and Information Processing #Semantic Web and Ontologies
  52. Retro-Search: Exploring Untaken Paths for Deeper and Efficient Reasoning
    2025/04/06 by Ximing Lu, Seungju Han, Lu, Ximing +19 · 5 citations
    Computer Science · #Intelligent Tutoring Systems and Adaptive Learning #Explainable Artificial Intelligence (XAI) #Advanced Graph Neural Networks
  53. Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data
    2025/09/26 by Syeda Nahida Akter, Akter, Syeda Nahida, Shrimai Prabhumoye +11 · 8 citations
    Computer Science · #Intelligent Tutoring Systems and Adaptive Learning
  54. Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation
    2026/03/19 by Zhuolin Yang, Zihan Liu, Yang Chen +14 · 3 voices
    Computer Science · #cs.CL #cs.AI #cs.LG
  55. Minitron-SSM: Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
    2025/04/15 by Ali Taghibakhshi, Taghibakhshi, Ali, Sharath Turuvekere Sreenivas +33 · 5 citations
    Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
  56. FeatSharp: Your Vision Model Features, Sharper
    2025/02/22 by Mike Ranzinger, Greg Heinrich, Ranzinger, Mike +9 · 3 citations
    Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Geographic Information Systems Studies
  57. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
    2025/12/23 by NVIDIA, Aaron Blakeman, : +623 · 1 voice · 2 citations
    #cs.CL #cs.AI #cs.LG
  58. On Data Engineering for Scaling LLM Terminal Capabilities
    2026/02/24 by Renjie Pi, Grace Lam, Mohammad Shoeybi +3 · 1 voice
    Computer Science · #cs.CL
  59. UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation
    2025/03/02 by Alexander H. Liu, Liu, Alexander H., Sang-gil Lee +13 · 3 citations
    Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
  60. Fine Detailed Texture Learning for 3D Meshes with Generative Models
    2022/03/17 by Ayşegül Dündar, Jun Gao, Dundar, Aysegul +5 · 1 citation
    Engineering · Computer Science · #3D Shape Modeling and Analysis #Advanced Vision and Imaging #Generative Adversarial Networks and Image Synthesis
  61. Audio Dialogues: Dialogues dataset for audio and music understanding
    2024/04/11 by Arushi Goel, Zhifeng Kong, Goel, Arushi +5 · 1 citation
    Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
  62. Effective Large Language Model Debugging with Best-first Tree Search
    2024/07/26 by Jialin Song, Song, Jialin, Jonathan Raiman +3 · 1 citation
    Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Software Engineering (cs.SE) #Topic Modeling
  63. Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset
    2025/08/20 by Rabeeh Karimi Mahabadi, Mahabadi, Rabeeh Karimi, Sanjeev Satheesh +9 · 1 voice · 5 citations
    #cs.CL #cs.AI #cs.LG
  64. PersonaPlex: Voice and Role Control for Full Duplex Conversational Speech Models
    2026/01/14 by Rajarshi Roy, Jonathan Raiman, Sang-gil Lee +5 · 1 voice · 1 citation
    Computer Science · #cs.CL
  65. RLP: Reinforcement as a Pretraining Objective
    2025/09/26 by Ali Hatamizadeh, Syeda Nahida Akter, Hatamizadeh, Ali +13 · 4 citations
    Psychology · #Behavioral and Psychological Studies
  66. OMCAT: Omni Context Aware Transformer
    2024/10/15 by Arushi Goel, Goel, Arushi, Karan Sapra +9 · 1 citation
    Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences
  67. Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos
    2026/07/17 by Sreyan Ghosh, Arushi Goel, Kaousheik Jayakumar +19
    #eess.AS #cs.CV
  68. SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales
    2026/07/13 by Mikail Khona, Aditya Vavre, Boxiang Wang +11
    #cs.LG #cs.AI