Deep Minds and Shallow Probes
The research investigates how neural representations are structured by analyzing probe families and underlying symmetries. It found that equivalent computations can exist under different coordinate systems, meaning probes must be invariant under these symmetries to reveal true structure. The key finding is that sharing the 'probe-visible quotient' allows for robust, coordinate-free transfer of concepts between different AI models.