Routing-Aware Safety Alignment for Mixture-of-Experts Models

Name: Routing-Aware Safety Alignment for Mixture-of-Experts Models
Uploaded: 2026-10-06T20:27:18.615963+00:00
Duration: 477 s
Description: Mixture-of-Experts (MoE) models face safety issues because standard fine-tuning can create 'alignment shortcuts' where safety improves through routing changes, not by fixing unsafe experts. RASA is a framework that fixes this by selectively fine-tuning only the most problematic experts and enforcing consistent routing, leading to robust safety against diverse jailbreaks.

Mixture-of-Experts (MoE) models face safety issues because standard fine-tuning can create 'alignment shortcuts' where safety improves through routing changes, not by fixing unsafe experts. RASA is a framework that fixes this by selectively fine-tuning only the most problematic experts and enforcing consistent routing, leading to robust safety against diverse jailbreaks.

Open the full episode