Zachary DeVito
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
2019/12/03 by Adam Paszke, Paszke, Adam, Sam Gross +41 · 1 voice · 4243 citations
Computer Science · Mathematics · #Computational Physics and Python Applications #Machine Learning and Data Classification #Parallel Computing and Optimization Techniques #cs.LG #cs.MS #stat.ML
- The Llama 3 Herd of Models
2024/07/31 by Aaron Grattafiori, Grattafiori, Aaron, Abhimanyu Dubey +1111 · 8 voices · 5043 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #cs.AI #cs.CL #cs.CV
- A Theory on Adam Instability in Large-Scale Machine Learning
2023/04/19 by Igor Molybog, Molybog, Igor, Peter J. Albert +33 · 1 voice · 12 citations
Computer Science · Mathematics · #Computational Physics and Python Applications #Neural Networks and Applications #Topic Modeling #cs.AI #cs.LG #math.OC
- Tensor Comprehensions: Framework-Agnostic High-Performance Machine Learning Abstractions
2018/02/13 by Nicolas Vasilache, Oleksandr Zinenko, Vasilache, Nicolas +15 · 1 voice · 46 citations
Computer Science · Mathematics · #Computational Physics and Python Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Programming Languages (cs.PL) #Tensor decomposition and applications #cs.LG #cs.PL
- Revisiting Reliability in Large-Scale Machine Learning Research Clusters
2024/10/29 by Apostolos Kokolis, Kokolis, Apostolos, Michael Kuchnik +19 · 2 voices · 18 citations
Business, Management and Accounting · Computer Science · Health Professions · #Artificial Intelligence in Healthcare #Big Data and Business Intelligence #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Parallel #and Cluster Computing (cs.DC) #cs.DC #cs.LG
- Torch.fx: Practical Program Capture and Transformation for Deep Learning in Python
2021/12/15 by James K. Reed, Zachary DeVito, Reed, James K. +7 · 12 citations
Computer Science · Decision Sciences · #Computational Physics and Python Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel Computing and Optimization Techniques #Scientific Computing and Data Management
- Is Flash Attention Stable?
2024/05/05 by Alicia Golden, Golden, Alicia, Samuel Hsia +19 · 1 voice · 2 citations
Computer Science · Engineering · Medicine · #Advanced Image Fusion Techniques #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Ocular and Laser Science Research #Parallel #Retinal Imaging and Analysis #and Cluster Computing (cs.DC) #cs.DC #cs.LG
- MAD Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems
2023/10/04 by Samuel Hsia, Hsia, Samuel, Alicia Golden +13 · 3 citations
Computer Science · #Advanced Neural Network Applications #Cloud Computing and Resource Management #Distributed #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)