A Circuit, Not The Circuit: Non-Unique Causal Localisation of the Mamba-2 State Sink
The episode discusses 'A Circuit, Not The Circuit,' detailing how Mamba-2's state sink phenomenon is composed of two functional groups: 'bos-specialists' and 'dual heads.' Hosts conclude that current single-bucket probes are insufficient for auditing AI, advocating instead for multi-class aggregation to achieve a more accurate understanding of model function.