When Scores Conflict with Preferences: Pre-Alignment Diagnosis and Adaptive Correction of Constraint Drift in DPO

arXiv:2611.07375 · cs.LG · Submitted 2026-11-05 · Read on arXiv

cs.LG

Submitted: 2026-11-05

Updated: 2026-11-05

Sources

Related papers