Davis, Damek
- Stochastic model-based minimization of weakly convex functions
2018/03/17 by Davis, Damek, Drusvyatskiy, Dmitriy · 30 citations
#65K05 #65K10 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Stochastic subgradient method converges on tame functions
2018/04/20 by Davis, Damek, Drusvyatskiy, Dmitriy, Kakade, Sham +1 · 19 citations
#65K05 #65K10 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- A Three-Operator Splitting Scheme and its Optimization Applications
2015/04/04 by Davis, Damek, Yin, Wotao · 14 citations
#47H05 #65K05 #65K15 #90C25 #FOS: Mathematics #Optimization and Control (math.OC)
- A gradient sampling method with complexity guarantees for Lipschitz functions in high and low dimensions
2021/12/13 by Davis, Damek, Drusvyatskiy, Dmitriy, Lee, Yin Tat +2 · 9 citations
#65K05 #65K10 #90C15 #90C30 #FOS: Mathematics #Optimization and Control (math.OC)
- Subgradient methods for sharp weakly convex functions
2018/03/06 by Davis, Damek, Drusvyatskiy, Dmitriy, MacPhee, Kellie J. +1 · 5 citations
#65K05 #65K10 #90C15 #90C30 #FOS: Mathematics #Optimization and Control (math.OC)
- Stochastic subgradient method converges at the rate O(k-1/4) on weakly convex functions
2018/02/08 by Davis, Damek, Drusvyatskiy, Dmitriy · 5 citations
#65K05 #65K10 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Convergence rate analysis of several splitting schemes
2014/06/18 by Damek Davis, Wotao Yin, Davis, Damek +1 · 4 citations
Computer Science · Engineering · Mathematics · #47H05 #65K05 #65K15 #90C25 #Advanced Optimization Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques
- Faster convergence rates of relaxed Peaceman-Rachford and ADMM under regularity assumptions
2014/07/19 by Damek Davis, Wotao Yin, Davis, Damek +1 · 4 citations
Computer Science · Engineering · #47H05 #65K05 #65K15 #90C25 #Direction-of-Arrival Estimation Techniques #FOS: Mathematics #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques
- Composite optimization for robust blind deconvolution
2019/01/06 by Vasileios Charisopoulos, Charisopoulos, Vasileios, Damek Davis +5 · 8 citations
Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Blind Source Separation Techniques #Advanced Image Processing Techniques
- Forward-Backward-Half Forward Algorithm for Solving Monotone Inclusions
2017/03/09 by Luis M. Briceño-Arias, Briceño-Arias, Luis M., Damek Davis +1 · 3 citations
Computer Science · Engineering · Mathematics · #47H05 #65K05 #65K15 #90C25 #FOS: Mathematics #Numerical methods in inverse problems #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques
- Active manifolds, stratifications, and convergence to local minima in nonsmooth optimization
2021/08/26 by Damek Davis, Dmitriy Drusvyatskiy, Davis, Damek +3 · 4 citations
Computer Science · Economics, Econometrics and Finance · Mathematics · #65K05 #65K10 #90C06 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Mathematical Biology Tumor Growth #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques #Stochastic processes and financial applications
- The nonsmooth landscape of phase retrieval
2017/11/09 by Davis, Damek, Drusvyatskiy, Dmitriy, Paquette, Courtney · 3 citations
#65K10 #90C06 #FOS: Mathematics #Optimization and Control (math.OC)
- Stochastic model-based minimization under high-order growth
2018/07/01 by Davis, Damek, Drusvyatskiy, Dmitriy, MacPhee, Kellie J. · 3 citations
#65K05 #65K10 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- SMART: The Stochastic Monotone Aggregated Root-Finding Algorithm
2016/01/04 by Damek Davis, Davis, Damek · 3 citations
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Complexity and Algorithms in Graphs
- Asymptotic normality and optimality in nonsmooth stochastic approximation
2023/01/16 by Damek Davis, Davis, Damek, Dmitriy Drusvyatskiy +3 · 2 citations
Computer Science · Decision Sciences · Economics, Econometrics and Finance · #65K05 #65K10 #90C06 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Optimization and Variational Analysis #Risk and Portfolio Optimization #Statistics Theory (math.ST) #Stochastic processes and financial applications
- Convergence rate analysis of the forward-Douglas-Rachford splitting scheme
2014/10/09 by Davis, Damek · 1 citation
#47H05 #65K05 #65K15 #90C25 #FOS: Mathematics #Optimization and Control (math.OC)
- Proximally Guided Stochastic Subgradient Method for Nonsmooth, Nonconvex Problems
2017/07/12 by Davis, Damek, Grimmer, Benjamin · 1 citation
#65K05 #65K10 #90C15 #90C26 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Graphical Convergence of Subgradients in Nonconvex Optimization and Learning
2018/10/17 by Davis, Damek, Drusvyatskiy, Dmitriy · 1 citation
#65K10 #68Q32 #90C15 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Low-rank matrix recovery with composite optimization: good conditioning\n and rapid convergence
2019/04/22 by Vasileios Charisopoulos, Charisopoulos, Vasileios, Yudong Chen +9 · 1 citation
Computer Science · Engineering · Physics and Astronomy · #65K10 #90C06 #Advanced X-ray Imaging Techniques #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optical measurement and interference techniques #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques
- Iteratively reweighted kernel machines efficiently learn sparse functions
2025/05/13 by Zhu, Libin, Davis, Damek, Drusvyatskiy, Dmitriy +1 · 5 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Statistics Theory (math.ST)
- Escaping strict saddle points of the Moreau envelope in nonsmooth optimization
2021/06/17 by Davis, Damek, Díaz, Mateo, Drusvyatskiy, Dmitriy · 1 citation
#65K05 #65K10 #90C06 #90C15 #90C30 #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- A nearly linearly convergent first-order method for nonsmooth functions with quadratic growth
2022/04/29 by Damek Davis, Davis, Damek, Liwei Jiang +1 · 1 citation
Computer Science · Mathematics · #65K05 #65K10 #90C15 #90C30 #Advanced Optimization Algorithms Research #FOS: Mathematics #Optimization and Control (math.OC) #Optimization and Variational Analysis #Stochastic Gradient Optimization Techniques
- A superlinearly convergent subgradient method for sharp semismooth problems
2022/01/12 by Charisopoulos, Vasileios, Davis, Damek · 1 citation
#65K05 #65K10 #90C06 #90C30 #FOS: Mathematics #Optimization and Control (math.OC)
- Aiming towards the minimizers: fast convergence of SGD for overparametrized problems
2023/06/05 by Liu, Chaoyue, Drusvyatskiy, Dmitriy, Belkin, Mikhail +2 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- A SMART Stochastic Algorithm for Nonconvex Optimization with\n Applications to Robust Machine Learning
2016/10/04 by Aleksandr Y. Aravkin, Damek Davis, Aravkin, Aleksandr +1 · 1 citation
Computer Science · #Stochastic Gradient Optimization Techniques #Neural Networks and Applications #Face and Expression Recognition
- When do spectral gradient updates help in deep learning?
2025/12/03 by Damek Davis, Davis, Damek, Dmitriy Drusvyatskiy +1 · 3 citations
Computer Science · Engineering · Physics and Astronomy · #Stochastic Gradient Optimization Techniques #Muon and positron interactions and applications #Particle physics theoretical and experimental studies
- Online Covariance Estimation in Nonsmooth Stochastic Approximation
2025/02/07 by Liwei Jiang, Abhishek Roy, Jiang, Liwei +9 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Data Management and Algorithms #Distributed Sensor Networks and Detection Algorithms #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)