An Open-Source Training Dataset for Foundation Models for Hyperparameter Optimization
cs.LG
Submitted: 2026-05-22
Updated: 2026-11-17
Code: https://github.com/Lightning-AI/pytorch-lightning
Terminology
Sources
- FunBO: Discovering Acquisition Functions for Bayesian Optimization with FunSearch
- HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisation
- COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting
- Training Compute-Optimal Large Language Models
- Scaling Laws for Neural Language Models
- Tabular Benchmarks for Joint Architecture and Hyperparameter Optimization
- LLaMEA-BO: A Large Language Model Evolutionary Algorithm for Automatically Generating Bayesian Optimization Algorithms
- TabRepo: A Large Scale Repository of Tabular Model Evaluations and its AutoML Applications
- Amplifying human performance in combinatorial competitive programming
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis