Dehao Chen
- GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
2020/06/30 by Dmitry Lepikhin, Lepikhin, Dmitry, HyoukJoong Lee +16 · 2 voices · 411 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Artificial intelligence #Artificial neural network #Compiler #Computation #Computer science #Machine Learning and Data Classification #Machine learning #Machine translation #Parallel computing #Programming language #Programming paradigm #Scaling #Topic Modeling #Transformer #Translation (biology) #Voltage #cs.CL #cs.LG #stat.ML
- LaMDA: Language Models for Dialog Applications
2022/01/20 by Romal Thoppilan, Thoppilan, Romal, Daniel De Freitas +126 · 2 voices · 104 citations
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems #Topic Modeling #cs.AI #cs.CL
- MLPerf Training Benchmark
2019/10/02 by Peter Mattson, Christine Cheng, Mattson, Peter +73 · 1 voice · 44 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Performance (cs.PF) #cs.LG #cs.PF #stat.ML
- GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
2018/11/16 by Yanping Huang, Youlong Cheng, Huang, Yanping +20 · 1 voice · 24 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Advanced Neural Network Applications #Cell Image Analysis Techniques #Computer Vision and Pattern Recognition (cs.CV) #Digital Imaging for Blood Diseases #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #cs.CV
- GSPMD: General and Scalable Parallelization for ML Computation Graphs
2021/05/10 by Yuanzhong Xu, HyoukJoong Lee, Xu, Yuanzhong +30 · 21 citations
Computer Science · #Advanced Data Storage Technologies #Advanced Neural Network Applications #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC) #cs.DC #cs.LG
- Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
2019/02/21 by Jonathan Shen, Shen, Jonathan, Patrick Nguyen +179 · 1 voice · 2 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
2020/04/28 by Yuanzhong Xu, Xu, Yuanzhong, HyoukJoong Lee +10 · 6 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC) #cs.DC #cs.LG #stat.ML
- Hardware Counted Profile-Guided Optimization
2014/11/24 by Baptiste Wicht, Wicht, Baptiste, Roberto A. Vitillo +5 · 1 citation
Computer Science · #FOS: Computer and information sciences #Programming Languages (cs.PL) #cs.PL