How Far Do Auto-Interpretation Labels Generalize: A Controlled Study Across Languages, Scripts, and Rewordings
Researchers tested if auto-generated labels for sparse autoencoder features generalize across different languages and scripts using Serbian as a testbed. While features encode abstract meaning, the labels often fail to capture this meaning when applied to different forms of content. This suggests labels reflect training data biases rather than universal concepts.