vix.ing · top · new · best · stats · spec

Mudigere, Dheevatsa

  1. On Large-Batch Training for Deep Learning: Generalization Gap and Sharp\n Minima
    2016/09/15 by Nitish Shirish Keskar, Keskar, Nitish Shirish, Dheevatsa Mudigere +7 · 184 citations
    Computer Science · #Stochastic Gradient Optimization Techniques #Machine Learning and Algorithms #Machine Learning and ELM
  2. Deep Learning Recommendation Model for Personalization and Recommendation Systems
    2019/05/31 by Maxim Naumov, Naumov, Maxim, Dheevatsa Mudigere +45 · 76 citations
    Computer Science · #Recommender Systems and Techniques #Privacy-Preserving Technologies in Data #Advanced Graph Neural Networks
  3. A Study of BFLOAT16 for Deep Learning Training
    2019/05/29 by Dhiraj Kalamkar, Kalamkar, Dhiraj, Dheevatsa Mudigere +35 · 33 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #Computational Physics and Python Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Tensor decomposition and applications
  4. A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
    2023/09/12 by Hao-Jun Michael Shi, Tsung-Hsien Lee, Shi, Hao-Jun Michael +13 · 15 citations
    Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Neural Networks and Applications
  5. RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing
    2019/12/30 by Liu Ke, Ke, Liu, Udit Gupta +39 · 9 citations
    Computer Science · #Caching and Content Delivery #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Parallel #Recommender Systems and Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
  6. Mixed Precision Training of Convolutional Neural Networks using Integer Operations
    2018/02/03 by Dipankar Das, Das, Dipankar, Naveen Mellempudi +31 · 10 citations
    Computer Science · Mathematics · #Advanced Neural Network Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE) #Numerical Analysis (math.NA) #Tensor decomposition and applications
  7. Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models
    2021/04/12 by Dheevatsa Mudigere, Yuchen Hao, Mudigere, Dheevatsa +103 · 9 citations
    Computer Science · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques
  8. TopoOpt: Co-optimizing Network Topology and Parallelization Strategy for Distributed Training Jobs
    2022/02/01 by Weiyang Wang, Moein Khazraee, Wang, Weiyang +13 · 9 citations
    Computer Science · Engineering · #Advanced Memory and Neural Computing #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Networking and Internet Architecture (cs.NI) #Parallel #and Cluster Computing (cs.DC)
  9. The Architectural Implications of Facebook's DNN-based Personalized Recommendation
    2019/06/06 by Gupta, Udit, Wu, Carole-Jean, Wang, Xiaodong +12 · 6 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  10. Distributed Deep Learning Using Synchronous Stochastic Gradient Descent
    2016/02/22 by Dipankar Das, Das, Dipankar, Sasikanth Avancha +13 · 1 voice · 1 citation
    Computer Science · #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG
  11. Mixed Dimension Embeddings with Application to Memory-Efficient Recommendation Systems
    2019/09/25 by Antonio Ginart, Ginart, Antonio, Maxim Naumov +7 · 5 citations
    Computer Science · #Advanced Graph Neural Networks #Caching and Content Delivery #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Recommender Systems and Techniques
  12. Supporting Massive DLRM Inference Through Software Defined Memory
    2021/10/21 by Ardestani, Ehsan K., Kim, Changkyu, Lee, Seung Jae +17 · 4 citations
    #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
  13. Mixed Low-precision Deep Learning Inference using Dynamic Fixed Point
    2017/01/31 by Naveen Mellempudi, Mellempudi, Naveen, Abhisek Kundu +7 · 1 voice · 1 citation
    Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural and Evolutionary Computing (cs.NE) #Robotics and Sensor-Based Localization #cs.LG #cs.NE
  14. Deep Learning Training in Facebook Data Centers: Design of Scale-up and Scale-out Systems
    2020/03/20 by Naumov, Maxim, Kim, John, Mudigere, Dheevatsa +12 · 3 citations
    #68M10 #68T05 #C.2.1 #Distributed #FOS: Computer and information sciences #H.3.3 #I.2.6 #Parallel #and Cluster Computing (cs.DC)
  15. A Progressive Batching L-BFGS Method for Machine Learning
    2018/02/15 by Raghu Bollapragada, Dheevatsa Mudigere, Bollapragada, Raghu +7 · 3 citations
    Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Machine Learning and Algorithms
  16. Disaggregated Multi-Tower: Topology-aware Modeling Technique for Efficient Large-Scale Recommendation
    2024/03/01 by Luo, Liang, Zhang, Buyun, Tsang, Michael +11 · 4 citations
    #Distributed #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  17. Ternary Neural Networks with Fine-Grained Quantization
    2017/05/02 by Naveen Mellempudi, Mellempudi, Naveen, Abhisek Kundu +9 · 4 citations
    Computer Science · #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Neural and Evolutionary Computing (cs.NE)
  18. Nonuniform-Tensor-Parallelism: Mitigating GPU failure impact for Scaled-up LLM Training
    2025/04/08 by Arfeen, Daiyaan, Mudigere, Dheevatsa, More, Ankit +3 · 2 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
  19. Beyond the Buzz: A Pragmatic Take on Inference Disaggregation
    2025/06/05 by Tiyasa Mitra, Mitra, Tiyasa, Ritika Borkar +23 · 4 citations
    Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Parallel #Parallel Computing and Optimization Techniques #Software-Defined Networks and 5G #and Cluster Computing (cs.DC)
  20. On Scale-out Deep Learning Training for Cloud and HPC
    2018/01/24 by Srinivas Sridharan, Karthikeyan Vaidyanathan, Sridharan, Srinivas +19 · 1 citation
    Computer Science · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)