Delay, Plateau, or Collapse: Evaluating the Impact of Systematic Verification Error on RLVR
This episode discusses the paper "Delay, Plateau, or Collapse," examining how systematic errors in verifiers affect Reinforcement Learning with Verifiable Rewards (RLVR). The hosts conclude that error patterns determine the outcome—delay, plateau, or collapse. Mitigation involves using a periodic "alternation" strategy to improve performance.