Paquette, Elliot
- 4+3 Phases of Compute-Optimal Neural Scaling Laws
2024/05/23 by Elliot Paquette, Courtney Paquette, Paquette, Elliot +5 · 21 citations
Computer Science · #Neural Networks and Applications
- The threshold for integer homology in random d-complexes
2013/08/28 by Hoffman, Christopher, Kahle, Matthew, Paquette, Elliot · 3 citations
#Algebraic Topology (math.AT) #Combinatorics (math.CO) #FOS: Mathematics #Probability (math.PR)
- SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality
2021/02/08 by Courtney Paquette, Paquette, Courtney, Kiwon Lee +5 · 4 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Probability (math.PR) #Random Matrices and Applications #Stochastic Gradient Optimization Techniques
- Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions
2022/06/15 by Courtney Paquette, Paquette, Courtney, Elliot Paquette +5 · 4 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Probability (math.PR) #Single-cell and spatial transcriptomics #Statistics Theory (math.ST) #Stochastic Gradient Optimization Techniques
- Secular Coefficients and the Holomorphic Multiplicative Chaos
2020/11/03 by Najnudel, Joseph, Paquette, Elliot, Simm, Nick · 3 citations
#60B20 #60F05 #60G42 #Combinatorics (math.CO) #FOS: Mathematics #FOS: Physical sciences #Mathematical Physics (math-ph) #Probability (math.PR)
- The integer homology threshold in Yd(n, p)
2018/08/31 by Newman, Andrew, Paquette, Elliot · 2 citations
#Algebraic Topology (math.AT) #Combinatorics (math.CO) #FOS: Mathematics #Probability (math.PR)
- Hitting the High-Dimensional Notes: An ODE for SGD learning dynamics on GLMs and multi-index models
2023/08/17 by Collins-Woodfin, Elizabeth, Paquette, Courtney, Paquette, Elliot +1 · 3 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Probability (math.PR) #Statistics Theory (math.ST)
- Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties
2022/05/14 by Paquette, Courtney, Paquette, Elliot, Adlam, Ben +1 · 2 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Probability (math.PR) #Statistics Theory (math.ST)
- Anchored expansion, speed, and the hyperbolic Poisson Voronoi tessellation
2014/09/15 by Benjamini, Itai, Paquette, Elliot, Pfeffer, Joshua · 1 citation
#FOS: Mathematics #Metric Geometry (math.MG) #Probability (math.PR)
- Distributional Lattices on Riemannian symmetric spaces
2017/07/02 by Paquette, Elliot · 1 citation
#22E40 #43A07 #60G55 #FOS: Mathematics #Geometric Topology (math.GT) #Probability (math.PR)
- Tridiagonal Models for Dyson Brownian Motion
2017/07/10 by Holcomb, Diane, Paquette, Elliot · 1 citation
#FOS: Mathematics #Probability (math.PR)
- A Furstenberg type formula for the speed of distance stationary sequences
2017/10/02 by Carrasco, Matias, Lessa, Pablo, Paquette, Elliot · 1 citation
#05C81 #34D08 #51M10 #60Dxx #60G55 #FOS: Mathematics #Probability (math.PR)
- The maximum deviation of the Sineβ counting process
2018/01/26 by Holcomb, Diane, Paquette, Elliot · 1 citation
#60B20 #FOS: Mathematics #Probability (math.PR)
- Halting Time is Predictable for Large Models: A Universality Property and Average-case Analysis
2020/06/08 by Courtney Paquette, Paquette, Courtney, Bart van Merriënboer +5 · 1 citation
Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- Anchored expansion of Delaunay complexes in real hyperbolic space and stationary point processes
2020/08/03 by Itaï Benjamini, Yoav Krauz, Benjamini, Itai +3 · 1 citation
Mathematics · #Advanced Combinatorial Mathematics #Point processes and geometric inequalities #Geometry and complex manifolds
- Strong approximation of Gaussian β-ensemble characteristic polynomials: the edge regime and the stochastic Airy function
2020/09/10 by Lambert, Gaultier, Paquette, Elliot · 1 citation
#FOS: Mathematics #FOS: Physical sciences #Mathematical Physics (math-ph) #Probability (math.PR)
- Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models
2021/06/07 by Courtney Paquette, Elliot Paquette, Paquette, Courtney +1 · 1 citation
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Probability (math.PR) #Random Matrices and Applications #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- The Fourier coefficients of the holomorphic multiplicative chaos in the limit of large frequency
2025/02/20 by Najnudel, Joseph, Paquette, Elliot, Simm, Nick +1 · 3 citations
#FOS: Mathematics #Probability (math.PR)
- Differentially Private Linear Regression with Linked Data
2023/08/01 by Lin, Shurong, Paquette, Elliot, Kolaczyk, Eric D. · 1 citation
#62-XX #68P27 #Cryptography and Security (cs.CR) #FOS: Computer and information sciences #G.3 #I.0 #Methodology (stat.ME)
- High-dimensional limit of one-pass SGD on least squares
2023/04/13 by Collins-Woodfin, Elizabeth, Paquette, Elliot · 1 citation
#60H30 #FOS: Mathematics #Probability (math.PR) #Statistics Theory (math.ST)
- Dyson Equation for Correlated Linearizations and Test Error of Random Features Regression
2023/12/14 by Hugo Latourelle-Vigeant, Elliot Paquette, Latourelle-Vigeant, Hugo +1 · 1 citation
Computer Science · Physics and Astronomy · #FOS: Mathematics #Model Reduction and Neural Networks #Neural Networks and Applications #Probability (math.PR) #Statistics Theory (math.ST) #Topological and Geometric Data Analysis
- Exact Risk Curves of signSGD in High-Dimensions: Quantifying Preconditioning and Noise-Compression Effects
2024/11/19 by Xiao, Ke Liang, Marshall, Noah, Agarwala, Atish +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)