Are We Recovering Mechanisms? Objective-Level Recovery Gaps in Mechanistic Interpretability
Mechanistic interpretability aims to recover internal model computations by finding circuits that mimic a model's behavior. However, a gap exists: faithfulness can prefer an equally sized circuit that reproduces the model less well. This happens because changing input signals (context distortion) alters how different circuits perform, leading to objective-level recovery gaps where better discovery methods fail.