Tight Stochastic Condition-Number Dependence in Nonconvex-Strongly-Concave Minimax Optimization
math.OC, cs.LG
Submitted: 2026-09-25
Updated: 2026-09-25
Comments: 20 pages
License: http://creativecommons.org/licenses/by/4.0/
The gist: We study whether the linear condition-number dependence in the stochastic complexity of SAPD+ is necessary for nonconvex-strongly-concave minimax optimization.
Terminology
Abstract
We study whether the linear condition-number dependence in the stochastic complexity of SAPD+ is necessary for nonconvex-strongly-concave minimax optimization. For jointly L-smooth objectives with dual strong-concavity parameter μ, we prove a lower bound that matches the SAPD+ upper bound under the same Moreau-envelope stationarity criterion and the same primal-dual initialization gap. Specifically, when σ epsilon, the worst-case complexity of zero-respecting algorithms is Θ(κLGσ 2 epsilon-4) in the stated accuracy regime, where κ=L/μ, G bounds the initial primal-dual gap, and σ squared bounds the variance of a general unbiased first-order oracle. The lower bound is realized on a smooth problem class with a bounded dual box. Our construction routes each link of a nonconvex zero-chain through a dual gradient of magnitude proportional to epsilon/sqrtκ, while an undiscovered primal coordinate prevents stationarity. It also yields the primal-gradient lower bound Ω(LΔ(sqrtκ epsilon-2+κσ 2 epsilon-4)) after combination with the known deterministic bound, where Δ bounds the initial primal function gap.
Sources
- SAPD+: An Accelerated Stochastic Method for Nonconvex-Concave Minimax Problems
- On the Condition Number Dependency in Bilevel Optimization
- Lower Complexity Bounds for Nonconvex-Strongly-Convex Bilevel Optimization with First-Order Oracles
Related papers
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
- Incremental Learning in Mirror Flows
- Second-Order Optimization with Asynchronous Curvature
- Online Control via Counterfactual Tracking
- Asynchronous Replanning in Two Population Linear Quadratic Mean Field Games: Information Requirements and Stability