Bandits in Prod: Hyperparameter Optimization at Inference Time
The episode discusses the paper "Bandits in Prod," which addresses online hyperparameter optimization at inference time. The authors frame this process as an Infinitely Many-Armed Bandit (IMAB).They propose IMABO, using learned oracles instead of random sampling to efficiently explore vast search spaces, resulting in a system designed for continuous improvement.