vix.ing · top · new · best · stats · spec

Narayanan, Deepak

  1. On the Opportunities and Risks of Foundation Models
    2021/08/16 by Rishi Bommasani, Drew A. Hudson, Bommasani, Rishi +233 · 11 voices · 652 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Adversarial Robustness in Machine Learning #Topic Modeling
  2. An Empirical Study of Mamba-based Language Models
    2024/06/12 by Roger Waleffe, Wonmin Byeon, Waleffe, Roger +30 · 1 voice · 56 citations
    Arts and Humanities · #Language, Linguistics, Cultural Analysis #cs.CL #cs.LG
  3. Efficient Large-Scale Language Model Training on GPU Clusters Using\n Megatron-LM
    2021/04/09 by Deepak Narayanan, Narayanan, Deepak, Mohammad Shoeybi +21 · 129 citations
    Computer Science · #Computation and Language (cs.CL) #Distributed #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
  4. BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
    2022/11/09 by Workshop, BigScience, :, Scao, Teven Le +391 · 125 citations
    #Computation and Language (cs.CL) #FOS: Computer and information sciences
  5. Llama-Nemotron: Efficient Reasoning Models
    2025/05/02 by Akhiad Bercovich, Bercovich, Akhiad, Itay Levy +224 · 1 voice · 35 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  6. PipeDream: Fast and Efficient Pipeline Parallel DNN Training
    2018/06/08 by Aaron Harlap, Deepak Narayanan, Harlap, Aaron +11 · 36 citations
    Computer Science · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  7. MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
    2022/11/29 by Trevor Gale, Gale, Trevor, Deepak Narayanan +5 · 34 citations
    Computer Science · #Domain Adaptation and Few-Shot Learning #Stochastic Gradient Optimization Techniques #Machine Learning and ELM
  8. Memory-Efficient Pipeline-Parallel DNN Training
    2020/06/16 by Deepak Narayanan, Narayanan, Deepak, Amar Phanishayee +7 · 21 citations
    Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Natural Language Processing Techniques #Parallel #Parallel Computing and Optimization Techniques #Topic Modeling #and Cluster Computing (cs.DC)
  9. Pretraining Large Language Models with NVFP4
    2025/09/29 by Felix Abecassis, NVIDIA, Abecassis, Felix +189 · 4 voices · 13 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL #cs.LG
  10. MLPerf Training Benchmark
    2019/10/02 by Peter Mattson, Mattson, Peter, Christine Cheng +71 · 26 citations
    Computer Science · #Advanced Neural Network Applications #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Performance (cs.PF)
  11. Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads
    2020/08/20 by Deepak Narayanan, Narayanan, Deepak, Keshav Santhanam +7 · 19 citations
    Computer Science · #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  12. Holistic Evaluation of Text-To-Image Models
    2023/11/07 by Lee, Tony, Yasunaga, Michihiro, Meng, Chenlin +15 · 19 citations
    #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  13. Nemotron-4 340B Technical Report
    2024/06/17 by Nvidia, :, Adler, Bo +80 · 24 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  14. Nemotron-4 15B Technical Report
    2024/02/26 by Jupinder Parmar, Parmar, Jupinder, Shrimai Prabhumoye +51 · 1 voice · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #cs.AI #cs.CL #cs.LG
  15. Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models
    2025/04/04 by NVIDIA, :, Blakeman, Aaron +198 · 30 citations
    #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
  16. Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP
    2021/10/22 by Narayanan, Deepak, Kazhamiaka, Fiodar, Abuzaid, Firas +5 · 7 citations
    #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
  17. NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model
    2025/08/20 by NVIDIA, Aarti Basant, : +305 · 24 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Big Data and Digital Economy #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques
  18. MacroBase: Prioritizing Attention in Fast Data
    2016/03/02 by Peter Bailis, Bailis, Peter, Edward Gan +9 · 1 citation
    Computer Science · #Data Stream Mining Techniques #Databases (cs.DB) #FOS: Computer and information sciences #Machine Learning and Data Classification #Neural Networks and Applications
  19. Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance\n Benchmark
    2018/06/04 by Cody Coleman, Coleman, Cody, Daniel Kang +17 · 1 citation
    Computer Science · Materials Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Machine Learning in Materials Science
  20. The Case for Co-Designing Model Architectures with Hardware
    2024/01/25 by Anthony, Quentin, Hatef, Jacob, Narayanan, Deepak +6 · 2 citations
    #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
  21. NVIDIA Nemotron 3: Efficient and Open Intelligence
    2025/12/24 by NVIDIA, :, Aaron Blakeman +453 · 4 citations
    Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Topic Modeling
  22. Weld: Rethinking the Interface Between Data-Intensive Applications
    2017/09/14 by Shoumik Palkar, Palkar, Shoumik, James Thomas +18 · 1 voice
    Computer Science · #Advanced Data Storage Technologies #Cloud Computing and Resource Management #Databases (cs.DB) #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Performance (cs.PF) #and Cluster Computing (cs.DC) #cs.DB #cs.DC #cs.PF
  23. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
    2025/12/23 by NVIDIA, Aaron Blakeman, : +623 · 1 voice · 2 citations
    #cs.CL #cs.AI #cs.LG