When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AI
cs.CY, cs.AI
Submitted: 2026-08-28
Updated: 2026-08-28
Comments: 24 pages, 4 tables. Expanded preprint with a structured public-artifact audit and three worked action paths
License: http://creativecommons.org/licenses/by/4.0/
The gist: Agentic AI is sold on a simple promise: the system keeps acting when the user stops watching.
Terminology
Abstract
Agentic AI is sold on a simple promise: the system keeps acting when the user stops watching. That promise creates an accountability inversion. As stepwise supervision recedes, verification does not disappear; it moves into the runtime infrastructure that defines authority, records action, interrupts execution, checks outcomes, and supports repair. We call this the reduced-supervision paradox. Using a 63-artifact audit, we examine its public visibility across 46 research papers and 17 engineering, documentation, security, and governance sources. We find that agents' action surfaces are far easier to reconstruct than the mechanisms needed to answer for their actions. Tool mediation and monitoring traces were clearly visible in 40 and 37 artifacts, whereas checkpoint placement was clearly visible in 6, validator independence in 4, recovery in 2, and contestability in 1. Three action paths show why this imbalance matters. A repository path can preserve rich diffs after a consequential change. A browser path can cross organizational boundaries faster than permissions travel. A service path can follow policy while leaving affected people without recourse. We argue that observability can become a substitute for accountability when it shifts verification onto users after meaningful intervention is no longer possible. Our action-path diagnostic instead asks whether a delegated action remains connected to authority, evidence, interruption, independent judgment, recovery, and challenge. The claim is deliberately bounded to public visibility; it does not establish the prevalence or effectiveness of undisclosed controls. We contribute an action-level account that recasts the harness from a technical wrapper into accountability infrastructure.
Sources
- SARC: A Governance-by-Architecture Framework for Agentic AI Systems
- WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks
- Building Effective AI Coding Agents for the Terminal: Scaffolding, Harness, Context Engineering, and Lessons Learned
- SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agents
- AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents
- WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?
- From Governance Norms to Enforceable Controls: A Layered Translation Method for Runtime Guardrails in Agentic AI
- ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities
- Natural-Language Agent Harnesses
- Identifying the Risks of LM Agents with an LM-Emulated Sandbox
- Toolformer: Language Models Can Teach Themselves to Use Tools
- Authenticated Delegation and Authorized AI Agents
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- OpenHands: An Open Platform for AI Software Developers as Generalist Agents
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
- OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks
- SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
- ReAct: Synergizing Reasoning and Acting in Language Models
- $\tau$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
Related papers
- Reasoning Enhances Robustness to Prompt Injection in LLM-Based Consensus
- Generative AI Purpose-built for Social and Mental Health: A Real-World Pilot
- PersonaMem-v3: Toward Omni-Platform Personal Intelligence for Holistic User Understanding, Recommendation, and Agentic Tasks
- What is an intelligent system?
- AI University: An LLM-Powered Learning Assistant for Engineering---A Finite Element Method Case Study
- Generative AI Use in Entrepreneurship: An Integrative Review and an Empowerment-Entrapment Framework