Multiplier and gradient methods

1969/11/01 by Magnus R. Hestenes · 94 citations
Mathematics · Computer Science · #Advanced Optimization Algorithms Research #Iterative Methods for Nonlinear Equations #Matrix Theory and Algorithms

paper · doi:10.1007/bf00927673

Cited by

• Multi-block Nonconvex Nonsmooth Proximal ADMM: Convergence and Rates Under Kurdyka–Łojasiewicz Property
• On the Global Convergence of a General Class of Augmented Lagrangian Methods
• The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent
• Modeling of the multi-scale related thermo-mechanical coupling behaviors in a helical cruciform fuel assembly
• Lagrange Multipliers and Optimality
• Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods
• Differentially Private Neural Network Training Under the Hidden State Assumption
• Limiting Stationarity of Regularized Gap-Function Reformulations for Bilevel Optimization with Unbounded Multipliers
• An Efficient Augmented Lagrangian Framework for Dynamic Optimal Transport on Surfaces Based on Second-Order Cone Programming Reformulation
• Hybrid Augmented Lagrangian Method for General Constrained Optimization via Evolutionary Algorithms
• Global Convergence of Inexact Augmented Lagrangian Method for Zero-One Composite Optimization
• Reducing Electricity Demand Charge for Data Centers with Partial Execution
• Multiscale Higher Order TV Operators for L1 Regularization
• Approximating Optimal Transport via Low-rank and Sparse Factorization
• Schwarzite and schwarzynes based load-bear resistant radial cellular\n griding-based 3D printed structures
• On the Equivalence of Inexact Proximal ALM and ADMM for a Class of Convex Composite Programming
• The Golden Ratio Proximal ADMM with Norm Independent Step-Sizes for Separable Convex Optimization
• Pontryagin-Bellman Differential Dynamic Programming for Low-Thrust Trajectory Optimization with Path Constraints
• Implementation of the ADMM to Parabolic Optimal Control Problems with Control Constraints and Beyond
• Direct inversion of data-space Hessian for efficient time-domain extended-source waveform inversion using the multiplier method
• A Low-rank Augmented Lagrangian Method for Polyhedral-SDP and Moment-SOS Relaxations of Polynomial Optimization
• Deep FlexQP: Accelerated Nonlinear Programming via Deep Unfolding
• Alternating Direction Algorithms for ℓ₁-Problems in Compressive Sensing
• Duality methods for solving variational inequalities
• Optimization of continuous-flow over traffic networks with fundamental diagram constraints
• Augmented Lagrangian methods for fully convex composite optimization
• Complexity of Proximal augmented Lagrangian for nonconvex optimization with nonlinear equality constraints
• Proximal gradient descent on the smoothed duality gap to solve saddle point problems
• Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimization
• Optimization of continuous-flow over traffic networks with fundamental diagram constraints
• Alternating Direction Method of Multipliers for Linear Inverse Problems
• A two-level distributed algorithm for nonconvex constrained optimization
• Indefinite linearized augmented Lagrangian method for convex programming with linear inequality constraints
• Estimation for bivariate quantile varying coefficient model
• Iteration complexity of first-order augmented Lagrangian methods for convex conic programming
• Subspace based low rank and joint sparse matrix recovery
• Balanced Augmented Lagrangian Method for Convex Programming
• On Certifying Non-uniform Bound against Adversarial Attacks
• Solving Optimization Problems over the Stiefel Manifold by Smooth Exact Penalty Function
• Zeroth Order Nonconvex Multi-Agent Optimization over Networks
• KKT Conditions, First-Order and Second-Order Optimization, and Distributed Optimization: Tutorial and Survey
• Fast Image Recovery Using Variable Splitting and Constrained Optimization
• Managing Randomization in the Multi-Block Alternating Direction Method of Multipliers for Quadratic Optimization
• Convergence of a Relative-type Inexact Proximal ALM for Convex Nonlinear Programming
• On the Convergence of Primal-Dual Hybrid Gradient Algorithm
• A projection-free dynamics for nonsmooth composite optimization
• A PyTorch Framework for Scalable Non-Crossing Quantile Regression
• Rayleigh Quotient Iteration, cubic convergence, and second covariant derivative
• Nonmonotone subgradient methods based on a local descent lemma
• Communication-Efficient Algorithms For Distributed Optimization
• A Novel Preconditioning Framework for Solving Nonlinear PDEs based on Fenchel-Rockafellar Duality and Transformed Primal-Dual Techniques
• An Augmented Lagrangian Method-Based Framework in the Adjoint Space for Sparse Reconstruction of Acoustic Sources
• Semi-infinite Nonconvex Constrained Min-Max Optimization
• The Rate of Convergence of the Augmented Lagrangian Method for a Nonlinear Semidefinite Nuclear Norm Composite Optimization Problem
• PENEX: AdaBoost-Inspired Neural Network Regularization
• Calibrating Generative Models
• On the Linear and Asymptotically Superlinear Convergence Rates of the Augmented Lagrangian Method with a Practical Relative Error Criterion
• An efficient algorithm for kernel quantile regression
• MadNCL: A GPU Implementation of Algorithm NCL for Large-Scale, Degenerate Nonlinear Programs
• A Sensitivity-Based Method for Bilevel Optimization Problems: Theoretical Analysis and Computational Performance
• Learning to Solve Optimization Problems Constrained with Partial Differential Equations
• Dual Optimistic Ascent (PI Control) is the Augmented Lagrangian Method in Disguise
• Responsive Safety in Reinforcement Learning by PID Lagrangian Methods
• Constructing Deep Neural Networks with a Priori Knowledge of Wireless Tasks
• A two-level distributed algorithm for nonconvex constrained optimization
• On the Optimal Linear Convergence Rate of a Generalized Proximal Point Algorithm
• Regression-based Network Reconstruction with Nodal and Dyadic Covariates and Random Effects
• Subspace Clustering of Subspaces: Unifying Canonical Correlation Analysis and Subspace Clustering
• A Continuous Feedback Optimal Control based on Second-Variations for Problems with Control Constraints
• An Optimal Control Interpretation of Augmented Distributed Optimization Algorithms
• Hybrid Learning and Optimization methods for solving Capacitated Vehicle Routing Problem
• Joint Long-Term Admission Control and Beamforming in Green Downlink Networks: Offline and Online Approaches
• A Class of Algorithms for General Instrumental Variable Models
• Q-Linear Convergence of the Proximal Augmented Lagrangian Method for Non-Convex Conic Programming
• PAL-Hom method for QP and an application to LP
• On the tensor nuclear norm and the total variation regularization for image and video completion
• Fast Proximal Linearized Alternating Direction Method of Multiplier with Parallel Splitting
• A proximal augmented Lagrangian method for nonconvex optimization with equality and inequality constraints
• User Manual for Model-based Imaging Inverse Problem
• Escape over a saddle by coloured noise: theory and numerics
• Low-Rank Regularized Convex-Non-Convex Problems for Image Segmentation or Completion
• Reflection Resource Management for Intelligent Reflecting Surface Aided Wireless Networks
• Conditionally adaptive augmented Lagrangian method for physics-informed learning of forward and inverse problems
• A dual-primal balanced augmented Lagrangian method for linearly constrained convex programming
• DOPE: Distributed Optimization for Pairwise Energies
• A simple and efficient algorithm for fused lasso signal approximator with convex loss function
• A Splitting Augmented Lagrangian Method for Low Multilinear-Rank Tensor Recovery
• An Alternating Direction Method Approach to Cloud Traffic Management
• A family of multi-parameterized proximal point algorithms
• A Two-level ADMM Algorithm for AC OPF with Global Convergence Guarantees
• Anomaly Detection via Graphical Lasso
• Monotone Operators and the Proximal Point Algorithm
• Extended Factorization Machine Annealing for Rapid Discovery of Transparent Conducting Materials
• The Augmented Mixing Method: Computing High-Accuracy Primal-Dual Solutions to Large-Scale SDPs via Column Updates