Measuring (some aspects of) the metacognition of AI
The study used meta-d' to measure AI's metacognitive sensitivity—its ability to rate its own confidence accurately—and signal detection theory to measure how AI adjusts decisions based on risk. Findings show LLMs have measurable sensitivity and can spontaneously regulate their choices according to uncertainty, though current metrics like AUC2 can give misleading conclusions.