How Much Do Circuits Tell Us? Measuring the Consistency and Specificity of Language Model Circuits
This episode discusses the paper "How Much Do Circuits Tell Us?" which investigates language model circuits using Edge Attribution Patching. Researchers found that these internal components are causally necessary for tasks, meaning performance drops significantly if disabled. However, they concluded that while these circuits are consistent across tasks, they are not specific to any single task.