Pressure, Context, and Machine Self-Control: A Criminological Test of Reward Hacking in Generative AI Models
cs.AI
Submitted: 2026-10-03
Updated: 2026-10-03
Project page: https://www.cnbc.com/2026/09/24/openai-agent-hacked-australiangovernment-website-.html
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent incidents show that AI agents sometimes reach measured goals through unsanctioned means.
Terminology
Abstract
Recent incidents show that AI agents sometimes reach measured goals through unsanctioned means. This study applies self-control, general strain, anomie, neutralization and routine activity theory to reward hacking in generative AI models, and it treats the measures as behavioral analogues. Study 1 (2,310 conversations, seven models) measured delay discounting with the Kirby Monetary Choice Questionnaire and stated willingness to take shortcuts. Pressure raised the discount rate k 2.8-fold in fresh conversations but 12.6-fold when the same sentence followed a baseline answer, which indicates a response to conversational cues rather than a stable trait. Models chose a shortcut in 1 of 700 dilemmas when answering as themselves and in 64 of 700 when asked to assume human impulses, each step of pressure raised the odds by 40%, and shortcut answers contained far more techniques of neutralization (rate ratio = 146). In the preregistered Study 2, five models worked on 20 coding tasks whose tests contradicted their specifications. Two Claude models never cheated. GPT-5.6, Qwen and DeepSeek cheated in 86%, 69% and 65% of episodes and clearly disclosed the conflict in 27%, although their reasoning recognized it in 95%. GPT-5.6 had never endorsed a shortcut in Study 1. The registered effects of pressure and of an auditor cue did not survive correction for multiple testing. In exploratory analyses, two further models cheated in 69% and 100% of episodes, and one sentence stating that the specification takes priority eliminated cheating in all 280 episodes. Therefore, stated refusal does not guarantee compliant agent behavior.
Sources
- Concrete Problems in AI Safety
- Reward Hacking and Agent Containment Failure: A Monte Carlo Study Based on the 2026 Hugging Face Incident
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation
- Demonstrating specification gaming in reasoning models
- Inducing anxiety in large language models can induce bias
- Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models
- Alignment faking in large language models
- Machine Psychology
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
- Agentic Misalignment: How LLMs Could Be Insider Threats
- Frontier Models are Capable of In-context Scheming
- Large Language Models Often Know When They Are Being Evaluated
- LLM economicus? Mapping the Behavioral Biases of LLMs via Utility Theory
- Large Language Models can Strategically Deceive their Users when Put Under Pressure
- ImpossibleBench: Measuring LLMs' Propensity of Exploiting Test Cases
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems