Machine Learning Algorithms for Improving Black Box Optimization Solvers
arXiv:2509.25592 · cs.LG · Submitted 2025-09-29 · Read on arXiv
cs.LG
Submitted: 2025-09-29
Updated: 2026-11-05
Terminology
- Benchmark — 35× in this paper · explained in 2 episodes
- Surrogate Model — 27× in this paper · explained in 4 episodes
- Robustness — 25× in this paper · explained in 7 episodes
- Machine Learning — 24× in this paper
- Benchmarking — 20× in this paper · explained in 4 episodes
- Direct Search — 19× in this paper
- Bayesian Optimization — 16× in this paper · explained in 3 episodes
- Objective Function — 15× in this paper · explained in 3 episodes
- AUC — 12× in this paper · explained in 2 episodes
- Adam — 12× in this paper · explained in 3 episodes
- Meta-learning — 12× in this paper · explained in 4 episodes
- Reinforcement Learning — 12× in this paper · explained in 5 episodes
- Q-learning — 11× in this paper · explained in 3 episodes
- Diffusion Model — 10× in this paper · explained in 12 episodes
- Evolution Strategies — 10× in this paper
- Differential Evolution — 7× in this paper
- Generalization — 7× in this paper · explained in 14 episodes
- Surrogate Modeling — 7× in this paper · explained in 3 episodes
- Surrogate Models — 7× in this paper · explained in 5 episodes
- Transformer — 7× in this paper · explained in 4 episodes
- Augmentation — 6× in this paper · explained in 2 episodes
- Radial Basis Function — 6× in this paper
- Fidelity — 5× in this paper · explained in 3 episodes
- Generative Model — 5× in this paper · explained in 2 episodes
- Generative Models — 5× in this paper · explained in 5 episodes
- Hyperparameters — 5× in this paper · explained in 2 episodes
- Policy Improvement with Black-Box — 5× in this paper
- Policy Optimization — 5× in this paper
- Black Box Optimization — 4× in this paper
- Consistency — 4× in this paper · explained in 3 episodes
- Diffusion Models — 4× in this paper · explained in 11 episodes
- Diversity — 4× in this paper · explained in 2 episodes
- Natural Evolution Strategies — 4× in this paper
- Regret — 4× in this paper · explained in 5 episodes
- Reinforcement Learning (RL) — 4× in this paper · explained in 26 episodes
- Automated Black-Box Optimizer — 3× in this paper
- Core — 3× in this paper · explained in 2 episodes
- Embeddings — 3× in this paper · explained in 2 episodes
- Evaluation Protocol — 3× in this paper · explained in 2 episodes
- Feed-Forward Mutation — 3× in this paper
- Regularization — 3× in this paper · explained in 3 episodes
- Artificial Intelligence — 2× in this paper
- Convex Optimization — 2× in this paper · explained in 2 episodes
- Decoupling — 2× in this paper · explained in 2 episodes
- Dynamic Algorithm Configuration — 2× in this paper
- Editor — 2× in this paper · explained in 2 episodes
- Gaussian Distribution — 2× in this paper · explained in 2 episodes
- Gaussian Process — 2× in this paper
- Generative Modeling — 2× in this paper · explained in 3 episodes
- Gradient Boosting — 2× in this paper
- Gradient Flow — 2× in this paper · explained in 3 episodes
- Inertia — 2× in this paper · explained in 2 episodes
- Neural Architecture Search — 2× in this paper
- Neural Surrogates — 2× in this paper · explained in 3 episodes
- Papers — 2× in this paper · explained in 3 episodes
- Particle Swarm Optimization — 2× in this paper
- Particle Swarm Optimization (PSO) — 2× in this paper · explained in 5 episodes
- Receiver Operating Characteristic — 2× in this paper
- Reward Function — 2× in this paper · explained in 5 episodes
- Sample Efficiency — 2× in this paper · explained in 7 episodes
- Sequential Model-Based Optimization — 2× in this paper
- Adversarial Examples — 1× in this paper · explained in 3 episodes
- Aggregated Evaluation Indicator — 1× in this paper
- Application Programming Interface — 1× in this paper
- Area Under the Receiver Operating Characteristic Curve — 1× in this paper
- Artificial Intelligence (AI) — 1× in this paper · explained in 2 episodes
- Bayesian Optimization (BO) — 1× in this paper · explained in 7 episodes
- Calibration — 1× in this paper · explained in 13 episodes
- Clustering — 1× in this paper · explained in 2 episodes
- Combinatorial Optimization — 1× in this paper · explained in 2 episodes
- Compatibility — 1× in this paper · explained in 2 episodes
- Conditional Diffusion Model — 1× in this paper · explained in 3 episodes
- Conference on High Performance Computing — 1× in this paper
- Constrained Binary Quadratic Problems — 1× in this paper
- Convergence Guarantees — 1× in this paper · explained in 3 episodes
- Convergence Rate — 1× in this paper · explained in 4 episodes
- Decode — 1× in this paper · explained in 2 episodes
- Diffusion Process — 1× in this paper · explained in 2 episodes
- Directed Acyclic Graph (DAG) — 1× in this paper · explained in 4 episodes
- Ensemble Learning — 1× in this paper · explained in 4 episodes
- Evolutionary Search — 1× in this paper · explained in 4 episodes
- Feature Selection — 1× in this paper · explained in 5 episodes
- Gaussian Process (GP) — 1× in this paper · explained in 4 episodes
- Heavy-Tailed Noise — 1× in this paper · explained in 3 episodes
- Hinge Loss — 1× in this paper · explained in 2 episodes
- Loss Function — 1× in this paper · explained in 3 episodes
- Markov Decision Process — 1× in this paper
- Markov Decision Process (MDP) — 1× in this paper · explained in 22 episodes
- Meta Generalization Decay — 1× in this paper
- Meta Transfer Efficiency — 1× in this paper
- Multi-objective Optimization — 1× in this paper · explained in 8 episodes
- Pseudo-labeling — 1× in this paper · explained in 3 episodes
- Robust Black-box Optimizer — 1× in this paper
- Score Function — 1× in this paper · explained in 6 episodes
- Self-Attention Crossover — 1× in this paper
- Sensitivity Analysis — 1× in this paper · explained in 3 episodes
- Standardized Metrics — 1× in this paper · explained in 3 episodes
- Transformer Architecture — 1× in this paper · explained in 5 episodes
- Uncertainty Quantification — 1× in this paper · explained in 13 episodes
- Variance Reduction — 1× in this paper · explained in 3 episodes
Sources
- Black-Box Optimization in Machine Learning with Trust Region Based Derivative Free Algorithm
- Reinforced In-Context Black-Box Optimization
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis