Incremental Open-Ended Deep Research with Structured Harness
cs.CL
Submitted: 2026-10-08
Updated: 2026-10-08
Code: https://github.com/modelscope/ms-agent2https:
Project page: https://ioedr-project.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Existing Open-Ended Deep Research (OEDR) systems primarily generate reports from scratch, making them inefficient for scenarios where research reports need to be continuously maintained as new
Terminology
Abstract
Existing Open-Ended Deep Research (OEDR) systems primarily generate reports from scratch, making them inefficient for scenarios where research reports need to be continuously maintained as new information emerges. We introduce Incremental Open-Ended Deep Research (Incremental-OEDR), a research setting that treats a report as an evolving research state and incrementally updates it by preserving valid knowledge, revising outdated or incomplete content, and incorporating newly available information. To support this setting, we propose Structured Harness, which represents reports as structured collections of outlines, sections, and supporting evidence, and provides structured retrieval, a persistent structured evidence pool, and structured generation for selective report updating and evidence reuse. We further establish a temporal evaluation framework spanning ten years, with Single-Step Task and Long-Chain Task to evaluate incremental updates over both individual transitions and long-term update chains. Extensive Experiments on DeepResearch Bench and DeepConsult under both the Open-source Configuration (OC) and Proprietary Configuration (PC) show that Incremental-OEDR maintains competitive report quality while substantially improving report continuity and reducing research costs. As shown in Figure, it achieves up to 0.51 higher content-level ROUGE-L F1, 0.63 higher outline-level EM F1, 33% lower token consumption, and 61% fewer search calls than OEDR on DeepResearch Bench. For more details, please refer to our project page: https://ioedr-project.github.io/.
Sources
- DeepResearchGym: A Free, Transparent, and Reproducible Evaluation Sandbox for Deep Research
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
- Deep Researcher with Test-Time Diffusion
- Deep Research Agents: A Systematic Examination And Roadmap
- WebSailor: Navigating Super-human Reasoning for Web Agent
- WebThinker: Empowering Large Reasoning Models with Deep Research Capability
- Dive into Claude Code: The Design Space of Today's and Future AI Agent Systems
- Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing
- DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesis
- WebResearcher: Unleashing unbounded reasoning capability in Long-Horizon Agents
- A Tale of Two Graphs: Separating Knowledge Exploration from Outline Structure for Open-Ended Deep Research
- Tongyi DeepResearch Technical Report
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
- BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
- WebDancer: Towards Autonomous Information Seeking Agency
- Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language Models
- Deep Research: A Survey of Autonomous Research Agents
- AgentOrchestra: Orchestrating Multi-Agent Intelligence with the Tool-Environment-Agent(TEA) Protocol
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering