Dead Weights, Live Signals: Feedforward Graphs of Frozen Language Models
This episode discusses the paper 'Dead Weights, Live Signals,' which uses feedforward graphs to map how knowledge flows through large language models. The hosts explain that this structural mapping allows researchers to diagnose specific weaknesses in a model's internal circuits. They conclude that AI development should shift from brute-force scaling toward targeted, modular improvements and greater interpretability.