Blake A. Hechtman
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
2021/12/08 by Jack W. Rae, Sebastian Borgeaud, Rae, Jack W. +157 · 74 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
- Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
2020/04/28 by Yuanzhong Xu, HyoukJoong Lee, Xu, Yuanzhong +9 · 2 citations
Computer Science · #Advanced Neural Network Applications #Distributed #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- TPU-KNN: K Nearest Neighbor Search at Peak FLOP/s
2022/06/28 by Felix Chern, Chern, Felix, Blake A. Hechtman +8 · 2 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithms and Data Compression #FOS: Computer and information sciences #Machine Learning (cs.LG) #Performance (cs.PF) #Tensor decomposition and applications