Harness-Search: Guiding Long-Horizon Search through Multi-Agent Coordination
cs.CL
Submitted: 2026-10-04
Updated: 2026-10-04
Comments: 26 pages, Natural Language Processing
Code: https://github.com/SwimmingWang/Harness-Search
License: http://creativecommons.org/licenses/by/4.0/
The gist: Long-horizon search requires agents to gather evidence across multiple steps and synthesize it into well-supported answers.
Abstract
Long-horizon search requires agents to gather evidence across multiple steps and synthesize it into well-supported answers. The recent agent harnesses provide a natural and promising framework to support such long-running search processes. As interaction histories grow, one single agent in harnesses might get stuck and cause the policy to lose track of unresolved questions, overlook useful evidence, or terminate before sufficient support has been collected. One of promising way is to decouple three distinct responsibilities of proposing retrieval actions, updating persistent state, and deciding when to stop rather than concentrating them within a single policy. Targeted at it, we introduce Harness-Search, a multi-agent search harness to reduce the local errors propagating across subsequent exploration, evidence curation, and termination decisions. In particular, Harness-Search assigns these responsibilities to three permission-bounded authorities: a Retrieval Policy that proposes search operations, a Memory Operator that validates and commits persistent-state updates, and a Summary Auditor that accepts or rejects termination based on the sufficiency of the curated evidence. Together, these roles form a Propose-Commit-Audit loop in which actions are proposed, persistent evidence is selectively committed, and stopping decisions are subjected to an explicit sufficiency check. Across seven long-horizon search benchmarks, Harness-Search improves both retrieval and answer generation under the same policy backbone, increasing Recall by 4.60-27.92 points and Final-Answer Recall by 12.34-30.13 points over the strongest harness-based baseline on each evidence-retrieval benchmark. Moreover, trajectory-level analyses show that Harness-Search continues to accumulate useful evidence and expand evidence coverage with less redundant retrieval as the search history grows.
Sources
- DecisionFlow: Advancing Large Language Model as Principled Decision Maker
- BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
- Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
- Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
- Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
- MemoHarness: Agent Harnesses That Learn from Experience
- Momentum-Coupled Rubric Adaptation for Detailed Image Captioning
- Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- ACM: Agentic Context Management for Long Horizon Tasks
- Spend Less, Reason Better: Budget-Aware Value Tree Search for LLM Agents
- GlobalRAG: Enhancing Global Reasoning in Multi-hop Question Answering via Reinforcement Learning
- LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks
- MemGPT: Towards LLMs as Operating Systems
- Natural-Language Agent Harnesses
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
- Is Grep All You Need? How Agent Harnesses Reshape Agentic Search
- AgenticRAG: Agentic Retrieval for Enterprise Knowledge Bases
- Tongyi DeepResearch Technical Report
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering