Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Model
The episode discusses the paper "Reading and Steering Representations of Materials-Science Mechanisms." Using the Gemma-four E4B-it model, researchers identified three ways to interpret internal representations of physics when processing materials science problems. The core conclusion is that static measurements are insufficient; testing how a model's internal structure transforms when intentionally steered is necessary for reliable physical reasoning.