ParallelPilot: Supporting Coordination and Monitoring in Parallel AI Coding
cs.HC, cs.AI, cs.DC, cs.MA
Submitted: 2026-09-27
Updated: 2026-09-27
License: http://creativecommons.org/licenses/by/4.0/
The gist: As coding assistants become increasingly autonomous, developers run multiple sessions in parallel, shifting the challenge from code generation alone to coordinating and monitoring concurrent agent
Terminology
Abstract
As coding assistants become increasingly autonomous, developers run multiple sessions in parallel, shifting the challenge from code generation alone to coordinating and monitoring concurrent agent work. Through a formative study (N=14), we identified PILOT: five supervisory practices for Planning, Isolating, Logging, Observing, and Triaging parallel sessions. We present ParallelPilot, a design probe that instantiates PILOT through a planning interface, a run-logger, and an ambient dashboard alongside existing coding tools. In a counterbalanced within-subjects study (N=16), participants using ParallelPilot increased ticket throughput by 63% in short coding tasks and supervised an average of one more concurrent agent at peak, while their tracking effort and context switching dropped. ParallelPilot also clarified execution plans, task dependencies, and intervention cues, and 14 of 16 participants preferred it over their current setup. These gains were not accompanied by significant improvements in perceived control or perceived success in redirecting the agents. Our findings demonstrate the value of explicit supervision support and position PILOT as a scaffold for designing tools that help people supervise concurrent work within and beyond coding. We suggest that future coding assistants should pair high-level awareness with low-cost paths back to the implementation evidence developers need to judge and steer agent work.
Sources
- Challenges in Human-Agent Communication
- One Developer Is All You Need: A Case Study of an AI-Augmented One-Person Squad in a Brownfield Enterprise
- "I'm Not Reading All of That": Understanding Software Engineers' Level of Cognitive Engagement with Agentic Coding Assistants
- Multi-Agent Collaboration via Evolving Orchestration
- Agentic Visualization: Extracting Agent-based Design Patterns from Visualization Systems
- Effective Strategies for Asynchronous Software Engineering Agents
- Overseeing Agents Without Constant Oversight: Challenges and Opportunities
- Professional Software Developers Don't Vibe, They Control: AI Agent Use for Coding in 2025
- XAI for Coding Agent Failures: Transforming Raw Execution Traces into Actionable Insights
- Agentic Coding in the Wild: Characterizing GitHub Copilot Traces at Production Scale
- AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systems
- On the Impact of AGENTS.md Files on the Efficiency of AI Coding Agents
- A survey of generative AI adoption and perceived productivity among scientists who program
- AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration
- "What Did It Actually Do?": Understanding Risk Awareness and Traceability for Computer-Use Agents
- Evolving with AI: A Longitudinal Analysis of Developer Logs
- When Parallelism Pays Off: Cohesion-Aware Task Partitioning for Multi-Agent Coding
- Coding with "Enemy": Can Human Developers Detect AI Agent Sabotage?
- AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol
- TraceLab: Characterizing Coding Agent Workloads for LLM Serving
Related papers
- Calibrating LLM Explanations to Human Decisions with Reinforcement Learning
- EduGage: A Multimodal Dataset and Benchmark for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
- EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution
- HAGI++: Head-Assisted Gaze Imputation and Generation
- Explanation User Interfaces: A Systematic Literature Review
- Hybrid Cinematography: Previsualizing and Managing Hallucination Risk in Generative Video Reshooting