System Switch: When Should a Fast Decision Model Stop and Think?
cs.AI
Submitted: 2026-10-07
Updated: 2026-10-07
Comments: 14 pages, 1 figure, 4 tables. Code, prompts and data: https://github.com/dexmac221/doomgemma (branch system-switch)
Code: https://github.com/dexmac221/doomgemma
Project page: https://freedoom.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Dual-process agents pair a fast policy with a slow deliberative model.
Abstract
Dual-process agents pair a fast policy with a slow deliberative model. In real-time settings the slow model usually runs continuously; in turn-based agents and robot planners it is invoked on events such as uncertainty or a detected failure. We study a fast learned actor that takes every decision and hands control to a reasoning vision-language model only when a gate opens, while the game keeps running. We use closed-loop Doom and the new open "System One" typed-decision models, served through a common llama.cpp interface. On 900 held-out questions, (i) zero-shot decision models from 0.15B to 9B parameters choose to collect items 1.6-1.8 times more often than chance among their errors, in any option order, although the order changes some models' accuracy; (ii) accuracy, calibration and sensitivity (how well confidence separates right from wrong answers) are distinct: models of similar accuracy differ widely in AUROC, and the confidence of the most sensitive one tracks which kinds of situation it fails, not which answers are wrong; (iii) offline, deferring the least confident 30% of decisions to a reasoning model gains over random deferral in proportion to the actor's AUROC (rank correlation 0.87); with actor and rate chosen on held-out games the gain is +0.13 [0.08, 0.18] with doomLaya's option order and +0.08 [0.02, 0.14] with shuffled options, and reasoning carries about half of it; (iv) in closed loop (33 games, three seeds) no variant reaches the exit. Committing to plans, the reasoner's or a fixed explore rule's, opens more doors and makes an actor that stands still play; with the rule the agent dies more often. Told that some doors need keys, the reasoner takes ordinary doors for locked ones, which the state cannot tell apart; without that knowledge it goes back to collecting. We release code, prompts, data and logs.
Sources
- Thinking Fast and Slow in AI
- Pangu Embedded: An Efficient Dual-system LLM Reasoner with Metacognition
- FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
- Agents Thinking Fast and Slow: A Talker-Reasoner Architecture
- Selective Classification for Deep Neural Networks
- Playing DOOM with 1.3M Parameters: Specialized Small Models vs Large Language Models for Real-Time Game Control
- DoReMi: Grounding Language Model by Detecting and Recovering from Plan-Execution Misalignment
- Inner Monologue: Embodied Reasoning through Planning with Language Models
- ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning
- SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks
- Cognitive Duality for Adaptive Web Agents
- Predict Responsibly: Improving Fairness and Accuracy by Learning to Defer
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- ReDAct: Uncertainty-Aware Deferral for LLM Agents
- Visual Agents as Fast and Slow Thinkers
- Real-Time Reasoning Agents in Evolving Environments
- Think Fast and Slow: Step-Level Cognitive Depth Adaptation for LLM Agents
- Leveraging Dual Process Theory in Language Agent Framework for Real-time Simultaneous Human-AI Collaboration
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems