Capability Provenance in Language Models: A Case Study in Social Reasoning
The research used Training-Data Attribution (TDA) to map specific parts of a massive text corpus to distinct model capabilities, contrasting social reasoning with STEM reasoning. Findings showed social reasoning is supported by broader, narrative data while STEM relies on technical documentation. Targeted machine unlearning validated that high attribution topics are functionally necessary for social tasks.