Chien-Chin Huang

1. PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel
   2023/04/21 by Yanli Zhao, Andrew Gu, Zhao, Yanli +31 · 180 citations
   Computer Science · #Advanced Neural Network Applications #Parallel Computing and Optimization Techniques #Advanced Data Storage Technologies
2. TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training
   2024/10/09 by Wanchao Liang, Tianyu Liu, Liang, Wanchao +23 · 41 citations
   Engineering · #Metallurgy and Material Forming #Manufacturing Process and Optimization
3. Unifying Data, Model and Hybrid Parallelism in Deep Learning via Tensor Tiling
   2018/05/10 by Minjie Wang, Chien-Chin Huang, Wang, Minjie +3 · 1 citation
   Computer Science · Mathematics · #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #Tensor decomposition and applications #and Cluster Computing (cs.DC)