Decoding Alignment without Encoding Alignment: A critique of similarity analysis in neuroscience
Decoding metrics like RSA and CKA compare neural representations but fail to capture how neurons are organized internally (encoding topology). The study shows these metrics remain unchanged even when the internal functional organization is manipulated. This means similarity in decoding output does not guarantee similarity in underlying computation or structure.