The Alignment Tax Is Graded: Task-Selective Capability Loss Under Length-Normalized DPO with SFT Retention

arXiv:2611.06476 · cs.LG · Submitted 2026-11-04 · Read on arXiv

cs.LG

Submitted: 2026-11-04

Updated: 2026-11-19

Code: https://github.com/yuan-phd/delta-filing

Terminology

Sources

Related papers