Recipes for Creativity: Iterative Generation and Evaluation in Large Language Models
The episode discusses a paper applying DeepMind's FunSearch algorithm to generate creative recipes for the Pillsbury Bake-Off. Hosts explore how iterative generation and evaluation affects creativity, finding that more iterations don't improve scores, but the size of the in-loop evaluator does—a smaller model yields more creative outputs. They emphasize selection over generation.