TADA! Tuning Audio Diffusion Models through Activation Steering
Researchers found that a small subset of shared attention layers within audio diffusion models controls most musical concepts like tempo or instrument choice. By focusing steering efforts only on these specific, localized layers, they achieved state-of-the-art control over musical attributes. This method is more effective than global steering and leads to perceptually seamless edits.