A Gravitational Interpretation of Safety Reversion under Fine-Tuning
The paper investigates why fine-tuning models after alignment often revert to earlier behaviors. It proposes a geometric interpretation: subsequent benign training acquires a component along a history-defined 'reversion manifold' that pulls the model back toward helpful regions from its initial training phases. This direction, 'vrev,' is shown to be causally linked to downstream safety outcomes.