FoMEMO: Towards Foundation Models for Expensive Multi-objective Optimization
cs.LG, cs.AI
Submitted: 2025-09-03
Updated: 2026-11-12
Terminology
Sources
- What learning algorithm is in-context learning? Investigations with linear models
- A Tutorial on Bayesian Optimization
- TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second
- BOFormer: Learning to Solve Multi-Objective Bayesian Optimization via Non-Markovian RL
- Adam: A Method for Stochastic Optimization
- Few for Many: Tchebycheff Set Scalarization for Many-Objective Optimization
- Smooth Tchebycheff Scalarization for Multi-Objective Optimization
- SGDR: Stochastic Gradient Descent with Warm Restarts
- Transformers Can Do Bayesian Inference
- Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling
- Language Model Embeddings Can Be Sufficient for Bayesian Optimization
- In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
- OmniPred: Language Models as Universal Regressors
- The Vizier Gaussian Process Bandit Algorithm
- Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings
- Meta-Learning Acquisition Functions for Transfer Learning in Bayesian Optimization
- Bayesian Optimization for Multi-objective Optimization and Multi-point Search
- Offline Multi-Objective Optimization
- ParetoFlow: Guided Flows in Multi-Objective Optimization
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis