- Handbook of Convergence Theorems for (Stochastic) Gradient Methods
2023/01/26 by Guillaume Garrigos, Robert M. Gower, Garrigos, Guillaume +1 · 2 voices · 65 citations
Computer Science · Engineering · Mathematics · #Applied mathematics #Computer science #Convergence (economics) #Convex function #Economics #Focus (optics) #Geometry #Gradient descent #Lipschitz continuity #Mathematical analysis #Mathematical optimization #Mathematical proof #Mathematics #Momentum (technical analysis) #Physics #Proximal Gradient Methods #Regular polygon #Simple (philosophy) #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference #Stochastic Gradient Optimization Techniques #Stochastic gradient descent #Subgradient method #math.OC
- First-Order Methods for Nonsmooth Nonconvex Functional Constrained Optimization with or without Slater Points
2022/12/02 by Zhichao Jia, Benjamin Grimmer, Jia, Zhichao +1 · 6 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #Applied mathematics #Compact space #Computer science #Constraint (computer-aided design) #Convex optimization #FOS: Mathematics #Lipschitz continuity #Mathematical analysis #Mathematical optimization #Mathematics #Optimization and Control (math.OC) #Optimization problem #Piecewise #Quadratic equation #Rate of convergence #Regular polygon #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Subgradient method
- On Distributed Nonconvex Optimization: Projected Subgradient Method for Weakly Convex Problems in Networks
2020/04/30 by Shixiang Chen, Alfredo Garcia, Shahin Shahrampour · 4 citations
Computer Science · Engineering · Mathematics · #Convergence (economics) #Convex function #Convex optimization #Markov Chains and Monte Carlo Methods #Regular polygon #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Stochastic approximation #Stochastic optimization #Subgradient method #cs.LG #math.OC #stat.ML
- Distributed Subgradient Projection Algorithm over Directed Graphs: Alternate Proof
2017/06/21 by Ran Xin, Xin, Ran, Chenguang Xi +3 · 4 citations
Computer Science · Engineering · Mathematics · #Advanced Memory and Neural Computing #Algorithm #Combinatorics #Computer science #Convergence (economics) #Convex function #Convex optimization #Directed graph #Discrete mathematics #Distributed Control Multi-Agent Systems #Distributed algorithm #Distributed computing #Focus (optics) #Function (biology) #Mathematical optimization #Mathematics #Projection (relational algebra) #Regular polygon #Set (abstract data type) #Stochastic Gradient Optimization Techniques #Subgradient method #math.OC
- Distributed Subgradient Methods and Quantization Effects
2008/03/08 by Angelia Nedić, Alex Olshevsky, Nedić, Angelia +5 · 3 citations
Computer Science · Mathematics · #Algorithm #Applied mathematics #Computer science #Distributed Control Multi-Agent Systems #FOS: Mathematics #Mathematical optimization #Mathematics #Neural Networks Stability and Synchronization #Neural Networks and Reservoir Computing #Optimization and Control (math.OC) #Quantization (signal processing) #Subgradient method #math.OC
- The Relaxation Method for Solving Systems of Linear Inequalities
1980/08/01 by Jean‐Louis Goffin · 3 citations
Mathematics · Computer Science · #Advanced Optimization Algorithms Research #Matrix Theory and Algorithms #Optimization and Variational Analysis #Subgradient method #Mathematics #Relaxation (psychology) #Polyhedron #Convergence (economics) #Rate of convergence #Applied mathematics #Range (aeronautics) #Mathematical optimization #Lagrangian relaxation #Combinatorics #Computer science