A switching proximal gradient method for constrained difference-of-convex optimization problems

arXiv:2610.37362 · math.OC · Submitted 2026-10-27 · Read on arXiv

math.OC

Submitted: 2026-10-27

Updated: 2026-10-27

License: http://creativecommons.org/licenses/by/4.0/

The gist: We study difference-of-convex optimization problems with several composite inequality constraints and develop a majorization-guided switching proximal gradient (MGSPG) method.

Abstract

We study difference-of-convex optimization problems with several composite inequality constraints and develop a majorization-guided switching proximal gradient (MGSPG) method. Specifically, at each feasible outer point, quadratic majorization and linearization yield a strongly convex composite surrogate problem. To solve this surrogate approximately, we employ a switching proximal gradient (SPG) method, which takes a proximal gradient step for the objective when the current point is nearly feasible and for a most violated constraint otherwise. This construction requires neither projection onto the joint surrogate feasible set nor multiplier computation. By establishing a common invariant ball and using an increasing weight argument, we obtain an O(τ-1) inner complexity bound for SPG. Building on this bound, we show that, under boundedness of the feasible level set and a uniform Slater condition for the surrogates, MGSPG finds an epsilon-KKT point in O(epsilon-2) outer iterations and O(epsilon-4) selected component proximal gradient updates. Numerical experiments on SCAD-constrained and groupwise-constrained regression problems demonstrate the viability and computational efficiency of our method compared with existing optimization algorithms.

Related papers