Decomposing and Measuring Evaluation Awareness

The research proposes a framework to measure how AI models detect when they are being tested and how that detection changes their actions. It decomposes this into recognizing external cues (like prompt structure) and then determining if those cues cause the model to become cautious or compliant, aiming to fix flawed benchmark results.

Open the full episode

More from AI Radio