Small Foundation Models of Human Cognition and Behaviour
The episode discusses a paper on 'Small Foundation Models of Human Cognition and Behaviour.' The authors demonstrate that smaller models can perform similarly to massive ones on familiar tasks. Crucial findings show these models understand task structure, not just memorize patterns. They provide a practical tool—a noise ceiling estimator—that helps cognitive scientists test theories by identifying where their predictions fail.