Mufan Bill Li
- Don't be lazy: CompleteP enables compute-efficient deep transformers
2025/05/02 by Bin Zhang, Dey, Nolan, Zhang, Bin Claire +14 · 1 voice · 20 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Parallel Computing and Optimization Techniques
- Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit
2023/09/28 by Blake Bordelon, Lorenzo Noci, Bordelon, Blake +7 · 9 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Physics and Astronomy · #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Disordered Systems and Neural Networks (cond-mat.dis-nn) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks
- The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
2022/06/06 by Mufan Bill Li, Li, Mufan Bill, Mihai Nica +3 · 3 citations
Computer Science · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Neural Networks and Applications #Stochastic Gradient Optimization Techniques