Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning
cs.AI, cs.MA
Submitted: 2026-10-08
Updated: 2026-10-08
License: http://creativecommons.org/licenses/by/4.0/
The gist: The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable
Abstract
The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on τ squared-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.
Sources
- Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
- EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repair
- Scaling Agent Learning via Experience Synthesis
- Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agent
- SEAD: Self-Evolving Agent for Multi-Turn Service Dialogue
- Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
- From Self-Evolving Synthetic Data to Verifiable-Reward RL: Post-Training Multi-turn Interactive Tool-Using Agents
- WRIT: Write-Read Intensive Trajectory Synthesis for Multi-Turn User-Facing Agents
- R-Zero: Self-Evolving Reasoning LLM from Zero Data
- SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Tasks
- Scaling Synthetic Task Generation for Agents via Exploration
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis
- Klear-AgentForge: Forging Agentic Intelligence through Posttraining Scaling
- Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolution
- EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle
- Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning
- ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
- Dr. Zero: Self-Evolving Search Agents without Training Data
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems