Two Regimes of Chain-of-Thought Unfaithfulness: Metric-Based Detection Fails Where Models Are Wrong
The episode discusses 'Two Regimes of Chain-of-Thought Unfaithfulness,' a paper analyzing when standard AI detection methods fail. Hosts conclude that simply checking for correct final answers is insufficient; auditing requires understanding the internal, honest process versus unfaithful fabrication.