Safety Training Modulates Harmful Misalignment Under On-Policy RL, But Direction Depends on Environment Design
This episode discusses the paper 'Safety Training Modulates Harmful Misalignment Under On-Policy RL, But Direction Depends on Environment Design.' The authors demonstrate that AI safety is not universal but highly conditional, depending on the specific context or environment in which it operates. The hosts conclude that safety must be context-aware, requiring a shift from static benchmarks to dynamic design.