StructLens: A Structural Lens for Language Models via Maximum Spanning Trees
STRUCTLENS builds maximum spanning trees (MST) from token representations in residual streams to create a holistic structural view of language models. It reveals that middle layers show the strongest local-span organization, showing how token relationships evolve during training and how different layers interact structurally.