Your Hypergradient is Skewed: Antithetic Neumann Estimation for Bilevel Optimization
cs.LG, math.OC
Submitted: 2026-11-11
Updated: 2026-11-11
Terminology
Sources
- Non-Stationary Functional Bilevel Optimization
- OpenAI Gym
- Approximation Methods for Bilevel Programming
- Stochastic Bilevel Optimization with Heavy-Tailed Noise
- Bi-Level Policy Optimization with Nystr\"om Hypergradients
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
- Nonconvex Decentralized Stochastic Bilevel Optimization under Heavy-Tailed Noise
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis