Pretrained Optimization Model for Zero-Shot Black Box Optimization
The episode discusses a new paper titled "Pretrained Optimization Model for Zero-Shot Black Box Optimization." The hosts explain that this model learns an optimization strategy by being pretrained on simple problems, allowing it to solve new, complex black-box optimization tasks without retraining. The authors found it outperforms traditional methods like CMA-ES and offers good few-shot fine-tuning capabilities.