Reasoning Resides in Layers: Restoring Temporal Reasoning in Video-Language Models with Layer-Selective Merging
The episode discusses a paper titled "Reasoning Resides in Layers," which proposes a method called MERIT for restoring temporal reasoning in video-language models by selectively merging parameters from an original text model. The hosts explain that this training-free approach improves temporal reasoning by nearly twenty-four percent on one benchmark, showing that reasoning is concentrated in specific layers.