TRACE: Trajectory-Based Safety Patch Learning for LLM Post-Training Realignment
TRACE addresses safety erosion during LLM fine-tuning by simulating harmful training paths to create a universal safety patch offline. It optimizes this patch to be disentangled from user task updates, solving the conflict between maintaining high safety and preserving task utility. The result is a single, robust patch that works across many different fine-tuning scenarios.