Huang, Jianyu
- The Llama 3 Herd of Models
2024/07/31 by Grattafiori, Aaron, Dubey, Abhimanyu, Jauhri, Abhinav +556 · 4102 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Deep Learning Recommendation Model for Personalization and Recommendation Systems
2019/05/31 by Maxim Naumov, Naumov, Maxim, Dheevatsa Mudigere +45 · 98 citations
Computer Science · #Recommender Systems and Techniques #Privacy-Preserving Technologies in Data #Advanced Graph Neural Networks
- A Study of BFLOAT16 for Deep Learning Training
2019/05/29 by Dhiraj Kalamkar, Kalamkar, Dhiraj, Dheevatsa Mudigere +35 · 48 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Computational Physics and Python Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Tensor decomposition and applications
- Software-Hardware Co-design for Fast and Scalable Training of Deep Learning Recommendation Models
2021/04/12 by Dheevatsa Mudigere, Mudigere, Dheevatsa, Yuchen Hao +103 · 14 citations
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques
- FBGEMM: Enabling High-Performance Low-Precision Deep Learning Inference
2021/01/13 by Daya Shanker Khudia, Khudia, Daya, Jianyu Huang +11 · 6 citations
Computer Science · #Advanced Data Storage Technologies #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Performance (cs.PF)
- Context Parallelism for Scalable Million-Token Inference
2024/11/04 by Amy Yang, Yang, Amy, H. J. Yang +15 · 10 citations
Computer Science · #Advanced Data Compression Techniques #Algorithms and Data Compression #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning in Healthcare #Parallel #and Cluster Computing (cs.DC)
- Mixed-Precision Embedding Using a Cache
2020/10/21 by Jie Yang, Jianyu Huang, Yang, Jie Amy +7 · 3 citations
Computer Science · #Advanced Graph Neural Networks #Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- WLB-LLM: Workload-Balanced 4D Parallelism for Large Language Model Training
2025/03/23 by Wang, Zheng, Cai, Anna, Xie, Xinfeng +9 · 11 citations
#Artificial Intelligence (cs.AI) #Distributed #FOS: Computer and information sciences #I.2.11 #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
- Implementing Strassen's Algorithm with BLIS
2016/05/03 by Jianyu Huang, Tyler Smith, Huang, Jianyu +5 · 1 citation
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies #Stochastic Gradient Optimization Techniques
- Efficient Speculative Decoding for Llama at Scale: Challenges and Solutions
2025/08/11 by Tang, Bangsheng, Fu, Carl Chengyan, Kou, Fei +35 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences