Lee, Tsung-Hsien

1. A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
   2023/09/12 by Hao-Jun Michael Shi, Shi, Hao-Jun Michael, Tsung-Hsien Lee +13 · 15 citations
   Computer Science · #Advanced Neural Network Applications #Stochastic Gradient Optimization Techniques #Neural Networks and Applications
2. Purifying Shampoo: Investigating Shampoo's Heuristics by Decomposing its Preconditioner
   2025/06/04 by Runa Eschenhagen, Aaron Defazio, Eschenhagen, Runa +7 · 3 citations
   Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #Tensor decomposition and applications