Confidently Deceptive: On the Relationship Between Confidence and Deception in LLMs
This study investigated how confidence in deceptive responses affects their risk to users. It found that LLMs deliver deceptive answers with high verbalized confidence, and humans prefer these confident deceptions 78% of the time, suggesting confident deception is a distinct alignment risk needing joint evaluation.