Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents
cs.AI, cs.CL
Submitted: 2026-09-29
Updated: 2026-09-29
Comments: 48 pages. Project page: https://dolev31.github.io/ProactiveInquirer/ Code: https://github.com/dolev31/ProactiveInquirer Model: https://huggingface.co/dolev31/ProactiveInquirer-Qwen3-8B
Project page: https://dolev31
License: http://creativecommons.org/licenses/by/4.0/
The gist: An agent that uses tools typically responds to what the user explicitly asks, yet completing the task may require information the user never requested.
Terminology
Abstract
An agent that uses tools typically responds to what the user explicitly asks, yet completing the task may require information the user never requested. Work on proactive agents mainly studies whether and when an agent should act on its own, not what information it should pursue. We study a distinct axis of proactivity: its content. Horizontal proactivity pursues unstated information that the current context already identifies, and vertical proactivity pursues needs that only earlier evidence reveals. A need graph, recovered from a benchmark's own decomposition, records which needs depend on which, so both forms, and whether the agent stops at the right time, can be scored from a transcript without a model judge. To learn this behavior, we propose Q&D (questioner and drafter), which trains a questioner to prefer the question whose continuation retrieves more of the required evidence, with no reward model or judge. On held-out splits of three multi-hop question-answering benchmarks, at equal retrieval spend, the trained questioner improves both forms of proactivity over the same model, prompted, and outperforms a prompted model 15 times larger in the same role on two of the three, and the gain persists after controlling for question volume and length. Without further training, we place the questioner in an interactive customer-service agent with a simulated customer, where it completes more tasks while asking fewer questions, and in retail it outperforms the 15 times larger model with fewer follow-up turns from the customer. These results show that proactivity depends not only on whether an agent acts without being asked, but also on what it chooses to pursue and when it stops.
Sources
- gpt-oss-120b & gpt-oss-20b Model Card
- Agentic Coding Needs Proactivity, Not Just Autonomy
- VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
- CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrieval
- Agents Explore but Agents Ignore: LLMs Lack Environmental Curiosity
- Balancing Autonomy and Alignment: A Multi-Dimensional Taxonomy for Autonomous LLM-powered Multi-Agent Architectures
- ProactBench: Beyond What The User Asked For
- VibeSearchBench: Benchmarking Long-horizon Proactive Search in the Wild
- Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs
- Length Desensitization in Direct Preference Optimization
- Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations
- PRISM: Agentic Retrieval with LLMs for Multi-Hop Question Answering
- Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistants
- Reliability without Validity: A Systematic, Large-Scale Evaluation of LLM-as-a-Judge Models Across Agreement, Consistency, and Bias
- UserBench: An Interactive Gym Environment for User-Centric Agents
- UserRL: Training Interactive User-Centric Agent via Reinforcement Learning
- Retrieval is Cheap, Show Me the Code: Executable Multi-Hop Reasoning for Retrieval-Augmented Generation
- Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation
- ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real-World Data
- When Search Agents Should Ask: DiscoBench for Clarification-Aware Deep Search
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems