Architecture Before the Formula: Individuating Neural Architecture Beyond the Composite Map
The episode discusses the paper "Architecture Before the Formula: Individuating Neural Architecture Beyond the Composite Map." Hosts discuss how existing neural architecture search methods treat models as simple combinations of parts. The paper advocates for a richer representation layer to quantify unique building blocks before combining them, shifting focus from scale to smarter structure and structural understanding.