Harmonic Representations in Symbolic Music Transformers are Localized and Controllable
The study investigated how symbolic music transformers understand harmonic structure by analyzing their internal representations during cadences. It found that harmonic knowledge develops progressively from middle layers, with mode understanding preceding key identity. Crucially, these internal representations are actionable: researchers can manipulate them at inference time to reliably steer the model toward specific resolutions while maintaining musical quality.