Robert M. Gower
- Handbook of Convergence Theorems for (Stochastic) Gradient Methods
2023/01/26 by Guillaume Garrigos, Garrigos, Guillaume, Robert M. Gower +1 · 2 voices · 38 citations
#math.OC
- The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm
2025/05/22 by Noah Amsel, David Persson, Amsel, Noah +5 · 7 voices · 15 citations
Computer Science · Engineering · Physics and Astronomy · #Coding theory and cryptography #Muon and positron interactions and applications #Particle physics theoretical and experimental studies #cs.AI #cs.CL #cs.LG #math.NA #math.OC
- SGD for Structured Nonconvex Functions: Learning Rates, Minibatching and\n Interpolation
2020/06/18 by Robert M. Gower, Othmane Sebbouh, Gower, Robert M. +4 · 8 citations
Computer Science · Decision Sciences · Engineering · #Advanced Bandit Algorithms Research #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- A general sample complexity analysis of vanilla policy gradient
2021/07/23 by Rui Yuan, Robert M. Gower, Yuan, Rui +3 · 8 citations
Computer Science · Decision Sciences · Mathematics · #Stochastic Gradient Optimization Techniques #Advanced Bandit Algorithms Research #Markov Chains and Monte Carlo Methods
- RSN: Randomized Subspace Newton
2019/05/26 by Robert M. Gower, Dmitry Kovalev, Gower, Robert M. +5 · 6 citations
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Machine Learning and Algorithms
- Sketched Newton-Raphson
2020/06/22 by Rui Yuan, Alessandro Lazaric, Yuan, Rui +3 · 3 citations
Computer Science · Engineering · Mathematics · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Advanced Optimization Algorithms Research
- Stochastic Dual Ascent for Solving Linear Systems
2015/12/21 by Robert M. Gower, Peter Richtárik, Gower, Robert Mansel +1 · 4 citations
Computer Science · Mathematics · #Advanced Optimization Algorithms Research #Complexity and Algorithms in Graphs #FOS: Mathematics #Numerical Analysis (math.NA) #Optimization and Control (math.OC) #Probability (math.PR) #Stochastic Gradient Optimization Techniques
- Improving Convergence and Generalization Using Parameter Symmetries
2023/05/22 by Bo Zhao, Zhao, Bo, Robert M. Gower +5 · 4 citations
Computer Science · Physics and Astronomy · #Matrix Theory and Algorithms #Neural Networks and Applications #Scientific Research and Discoveries
- Variational Inference with Gaussian Score Matching
2023/07/15 by Chirag Modi, Charles C. Margossian, Modi, Chirag +9 · 4 citations
Computer Science · Mathematics · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Statistical Methods and Inference
- EigenVI: score-based variational inference with orthogonal function expansions
2024/10/31 by Diana Cai, Cai, Diana, Chirag Modi +10 · 2 voices · 5 citations
Physics and Astronomy · Computer Science · #Model Reduction and Neural Networks #Domain Adaptation and Few-Shot Learning #Generative Adversarial Networks and Image Synthesis
- Provable convergence guarantees for black-box variational inference
2023/06/04 by Justin Domke, Guillaume Garrigos, Domke, Justin +3 · 3 citations
Computer Science · Mathematics · #Stochastic Gradient Optimization Techniques #Machine Learning and Algorithms #Markov Chains and Monte Carlo Methods
- Linear Convergence of Natural Policy Gradient Methods with Log-Linear Policies
2022/10/04 by Rui Yuan, Simon S. Du, Yuan, Rui +7 · 2 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Reinforcement Learning in Robotics #Stochastic Gradient Optimization Techniques
- Fast Linear Convergence of Randomized BFGS
2020/02/26 by Dmitry Kovalev, Robert M. Gower, Kovalev, Dmitry +5 · 3 citations
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Face and Expression Recognition #Sparse and Compressive Sensing Techniques
- The Power of Factorial Powers: New Parameter settings for (Stochastic)\n Optimization
2020/06/01 by Aaron Defazio, Robert M. Gower, Defazio, Aaron +1 · 1 citation
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms
2023/12/28 by Farshed Abdukhakimov, Abdukhakimov, Farshed, Chulu Xiang +7 · 2 citations
Computer Science · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and ELM #Neural Networks and Applications #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- Stochastic Block BFGS: Squeezing More Curvature out of Data
2016/03/31 by Robert M. Gower, Donald Goldfarb, Gower, Robert M. +3 · 1 citation
Computer Science · Engineering · #15B52 #62L20 #65Y20 #68W20 #68W40 #74S60 #90C06 #90C53 #FOS: Mathematics #Face and Expression Recognition #G.1.6 #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- An Exploration of Non-Euclidean Gradient Descent: Muon and its Many Variants
2025/10/10 by Michael Crawshaw, Chirag Modi, Crawshaw, Michael +5 · 1 voice · 5 citations
#cs.LG #stat.ML
- Action constrained quasi-Newton methods
2014/12/27 by Robert M. Gower, Jacek Gondzio, Gower, Robert Mansel +1 · 1 citation
Computer Science · Mathematics · Engineering · #Matrix Theory and Algorithms #Advanced Optimization Algorithms Research #Sparse and Compressive Sensing Techniques
- PoLoRA: A Preconditioned Orthogonalized LoRA Optimizer
2026/07/20 by Nikhil Ghosh, Tetiana Parshakova, Robert M. Gower
#cs.LG #cs.CL #math.OC