On Stability in Optimistic Bilevel Optimization
Johannes O. Royset
math.OC, cs.LG, cs.SY, eess.SY
Submitted: 2026-08-17
Updated: 2026-08-19
Journal ref: On Stability in Optimistic Bilevel Optimization JO Royset, SIAM Journal on Optimization 36 (2), 987-1016, 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Solutions of bilevel optimization problems tend to suffer from instability under changes to problem data.
Terminology
Abstract
Solutions of bilevel optimization problems tend to suffer from instability under changes to problem data. In the optimistic setting, we construct a lifted formulation that exhibits desirable stability properties under mild assumptions that neither invoke convexity nor smoothness. The upper- and lower-level problems might involve integer restrictions and disjunctive constraints. In a range of results, we invoke at most pointwise and local calmness for the lower-level problem in a sense that holds broadly. The lifted formulation is computationally attractive with structural properties being brought out and an outer approximation algorithm becoming available.
Sources
- Theoretical smoothing frameworks for nonsmooth simple bilevel problems
- On Penalty Methods for Nonconvex Bilevel Optimization and First-Order Stochastic Approximation
Related papers
- Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise
- Adam-HNAG: A Convergent Reformulation of Adam with Accelerated Rate
- Incremental Learning in Mirror Flows
- Beyond Aggregate Drift: Optimal Client-Specific Windows in Federated Learning
- Lower Bounds for Randomized Linear-Oracle Optimization over Strongly Convex Sets
- Second-Order Optimization with Asynchronous Curvature