From Tool to Agent: How Worker Needs Reorganize Across the Agentic Roles of Workplace AI
cs.AI, cs.HC
Submitted: 2026-05-04
Updated: 2026-10-04
Comments: 10 pages. To appear at the 14th International Conference on Human-Agent Interaction (HAI '26). Revised from the previous version
License: http://creativecommons.org/licenses/by/4.0/
The gist: As AI systems gain agency in workplaces, workers increasingly interact with systems that do more than support tasks: they make decisions, allocate work, and shape how workers communicate with others.
Terminology
Abstract
As AI systems gain agency in workplaces, workers increasingly interact with systems that do more than support tasks: they make decisions, allocate work, and shape how workers communicate with others. We interviewed 16 workers in healthcare, finance, and management about their daily interactions with workplace AI systems. Across these domains, AI occupied three agentic roles: assistant, supporting worker decision-making; arbiter, making consequential decisions that workers had to explain to downstream stakeholders; and manager, directing work and displacing social structures through which work had been negotiated and learned. We find that worker needs depended on how decision authority and accountability were configured around the AI system. Explanation, control, accountability, and communication each took different meanings depending on whether AI supported, decided, or directed work. We contribute a role-based account of workplace human-agent interaction and identify accountability-authority asymmetry as a mechanism through which AI deployments can place responsibility on workers for outcomes whose authority has shifted to AI. We discuss implications for designing workplace AI around both the agent and its surrounding agency configuration.
Sources
- Levels of Autonomy for AI Agents
- U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning
- Fully Autonomous AI Agents Should Not be Developed
- Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforce
- Authenticated Delegation and Authorized AI Agents
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems