Gu, Andrew
- The Llama 3 Herd of Models
2024/07/31 by Grattafiori, Aaron, Dubey, Abhimanyu, Jauhri, Abhinav +556 · 4863 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
2023/04/21 by Yanli Zhao, Andrew Gu, Zhao, Yanli +31 · 177 citations
Computer Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
- TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
2024/10/09 by Wanchao Liang, Liang, Wanchao, Tianyu Liu +23 · 40 citations
Engineering · #Metallurgy and Material Forming #Manufacturing Process and Optimization
- SimpleFSDP: Simpler Fully Sharded Data Parallel with torch.compile
2024/11/01 by Ruisi Zhang, Zhang, Ruisi, Tianyu Liu +11 · 3 citations
Computer Science · #Distributed and Parallel Computing Systems #Parallel Computing and Optimization Techniques
- Arithmetic of weighted Catalan numbers
2019/08/11 by Gao, Yibo, Gu, Andrew · 1 citation
#Combinatorics (math.CO) #FOS: Mathematics #Number Theory (math.NT)