Response-Based Knowledge Distillation for Multilingual Jailbreak Prevention Unwittingly Compromises Safety
Standard fine-tuning student models using safe refusal data from a teacher model inadvertently increases Jailbreak Success Rate (JSR) across all student models, up to 16.6 percentage points. This response-based knowledge distillation systematically degrades model safety in multilingual settings by introducing nuanced boundary examples and amplifying latent vulnerabilities.