What Do Rationales Communicate? A Message-Intervention Study in Role-Specialized QA
The study tested whether passing a rationale to a verifier changes its behavior. They used a 'message-intervention' diagnostic, varying only the rationale while keeping other inputs fixed. Findings show that harmless rationales rarely change judgments, but corrupted ones strongly alter support assessments. This suggests rationales are better as verification signals than answer selection guides.