A switching proximal gradient method for constrained difference-of-convex optimization problems
math.OC
Submitted: 2026-10-27
Updated: 2026-10-27
License: http://creativecommons.org/licenses/by/4.0/
The gist: We study difference-of-convex optimization problems with several composite inequality constraints and develop a majorization-guided switching proximal gradient (MGSPG) method.
Abstract
We study difference-of-convex optimization problems with several composite inequality constraints and develop a majorization-guided switching proximal gradient (MGSPG) method. Specifically, at each feasible outer point, quadratic majorization and linearization yield a strongly convex composite surrogate problem. To solve this surrogate approximately, we employ a switching proximal gradient (SPG) method, which takes a proximal gradient step for the objective when the current point is nearly feasible and for a most violated constraint otherwise. This construction requires neither projection onto the joint surrogate feasible set nor multiplier computation. By establishing a common invariant ball and using an increasing weight argument, we obtain an O(τ-1) inner complexity bound for SPG. Building on this bound, we show that, under boundedness of the feasible level set and a uniform Slater condition for the surrogates, MGSPG finds an epsilon-KKT point in O(epsilon-2) outer iterations and O(epsilon-4) selected component proximal gradient updates. Numerical experiments on SCAD-constrained and groupwise-constrained regression problems demonstrate the viability and computational efficiency of our method compared with existing optimization algorithms.
Related papers
- An Accelerated Proximal Gradient Method for Bures-Wasserstein Space
- FOMTools: Development and AI-Assisted Code Generation for First-Order Methods
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Dynamic Service Recommendation with Congestion-Dependent Joining: Near-Optimal and Constant-Factor Approximation Algorithms
- Integrating Learning and Optimization for Open Transport Capacity Pooling under Disruption
- Zeroth-Order Gradient Estimators under Decision-Dependent Noise