Boris Hanin

1. The Principles of Deep Learning Theory
   2021/06/18 by Daniel A. Roberts, Sho Yaida, Boris Hanin · 11 voices · 13 citations
   Computer Science · Physics and Astronomy · #Neural Networks and Applications #Anomaly Detection Techniques and Applications #Statistical Mechanics and Entropy
2. Don't be lazy: CompleteP enables compute-efficient deep transformers
   2025/05/02 by Dey, Nolan, Bin Zhang, Zhang, Bin Claire +14 · 1 voice · 20 citations
   Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Neural Networks and Applications #Parallel Computing and Optimization Techniques
3. Approximating Continuous Functions by ReLU Nets of Minimal Width
   2017/10/31 by Boris Hanin, Hanin, Boris, Mark Sellke +1 · 9 citations
   Computer Science · Engineering · #Advanced Neural Network Applications #Advanced Numerical Analysis Techniques #Combinatorics (math.CO) #Computational Complexity (cs.CC) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Statistics Theory (math.ST)
4. Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems
   2024/03/04 by Lingjiao Chen, Jared Quincy Davis, Chen, Lingjiao +11 · 17 citations
   Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Artificial Intelligence in Law #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Law, AI, and Intellectual Property #Machine Learning (cs.LG) #Systems and Control (eess.SY) #electronic engineering #information engineering
5. Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization
   2024/10/11 by Noam Razin, Razin, Noam, Sadhika Malladi +10 · 4 voices · 9 citations
   Economics, Econometrics and Finance · #Economic and Environmental Valuation
6. Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit
   2023/09/28 by Blake Bordelon, Bordelon, Blake, Lorenzo Noci +7 · 9 citations
   Biochemistry, Genetics and Molecular Biology · Computer Science · Physics and Astronomy · #Artificial Intelligence (cs.AI) #Cell Image Analysis Techniques #Disordered Systems and Neural Networks (cond-mat.dis-nn) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks
7. Quantitative CLTs in Deep Neural Networks
   2023/07/12 by Stefano Favaro, Favaro, Stefano, Boris Hanin +7 · 5 citations
   Computer Science · Mathematics · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Probability (math.PR) #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques
8. Local Universality for Zeros and Critical Points of Monochromatic Random\n Waves
   2016/10/28 by Yaiza Canzani, Canzani, Yaiza, Boris Hanin +1 · 1 citation
   Mathematics · #Geometry and complex manifolds #Geometric Analysis and Curvature Flows
9. Deep ReLU Networks Preserve Expected Length
   2021/02/21 by Boris Hanin, Ryan Jeong, Hanin, Boris +3 · 2 citations
   Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Neural Networks and Applications
10. Maximal Initial Learning Rates in Deep ReLU Networks
    2022/12/14 by Gaurav Iyer, Boris Hanin, Iyer, Gaurav +3 · 1 citation
    Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
11. Random neural networks in the infinite width limit as Gaussian processes
    2023/12/01 by Boris Hanin · 1 citation
    Computer Science · Engineering · #Control Systems and Identification #Face and Expression Recognition #Neural Networks and Applications