Chen, Dehao
- GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
2020/06/30 by Dmitry Lepikhin, Lepikhin, Dmitry, HyoukJoong Lee +16 · 2 voices · 294 citations
Computer Science · #Advanced Neural Network Applications #Machine Learning and Data Classification #Topic Modeling #cs.CL #cs.LG #stat.ML
- LaMDA: Language Models for Dialog Applications
2022/01/20 by Romal Thoppilan, Thoppilan, Romal, Daniel De Freitas +117 · 2 voices · 54 citations
#cs.CL #cs.AI
- MLPerf Training Benchmark
2019/10/02 by Peter Mattson, Mattson, Peter, Christine Cheng +71 · 26 citations
Computer Science · #Advanced Neural Network Applications #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Performance (cs.PF)
- GSPMD: General and Scalable Parallelization for ML Computation Graphs
2021/05/10 by Yuanzhong Xu, Xu, Yuanzhong, HyoukJoong Lee +29 · 16 citations
Computer Science · #Advanced Data Storage Technologies #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
2020/04/28 by Yuanzhong Xu, HyoukJoong Lee, Xu, Yuanzhong +9 · 5 citations
Computer Science · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
2019/02/21 by Jonathan Shen, Patrick Nguyen, Shen, Jonathan +179 · 1 voice · 1 citation
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Hardware Counted Profile-Guided Optimization
2014/11/24 by Wicht, Baptiste, Vitillo, Roberto A., Chen, Dehao +1 · 1 citation
#FOS: Computer and information sciences #Programming Languages (cs.PL)