AIM: Agentic Idea Management for Automated Research
cs.AI, cs.CE
Submitted: 2026-09-29
Updated: 2026-09-29
Project page: https://imhgchoi.github.io/agentic-idea-manager
License: http://creativecommons.org/licenses/by/4.0/
The gist: Frontier LLMs are increasingly used to automate scientific research through iterative search.
Abstract
Frontier LLMs are increasingly used to automate scientific research through iterative search. We distinguish idea-driven search from solution-driven search and identify three core challenges: organizing evolving research ideas, selecting promising directions, and maintaining alignment between ideas and their implementations. To address these challenges, we introduce the Agentic Idea Manager (AIM), a fully autonomous framework for managing and exploring research directions in idea-driven automated research. Inspired by Bayesian optimization, AIM uses an Agentic Surrogate and an Agentic Acquisition mechanism to organize discovered ideas and guide their selection. A Solution Auditor maintains idea-solution integrity, while a Resource Planner adaptively allocates the remaining experimental budget across parallel search branches. Experiments on 10 AutoLab benchmark tasks show that AIM surpasses the strongest baseline by 1.6 percentage points on System Optimization tasks and 4.9 percentage points on long-horizon Model Development & CUDA tasks. Notably, AIM reaches the best baseline performance up to 3.1x faster in wall-clock time. We further provide a theoretical analysis of when searching over ideas becomes beneficial. Our analysis shows that explicit idea-level allocation makes semantic coverage directly controllable, and that broader coverage becomes increasingly valuable when competitive research directions are sparse among many plausible alternatives. Project Page: https://imhgchoi.github.io/agentic-idea-manager/
Sources
- AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimization
- Multi-Agent LLMs Fail to Explore Each Other
- AI Research Preference Models
- ResearchGym: Evaluating Language Model Agents on Real-World AI Research
- CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentation
- AIDE: AI-Driven Exploration in the Space of Code
- Toward Generalist Autonomous Research via Hypothesis-Tree Refinement
- Gemini Embedding: Generalizable Embeddings from Gemini
- MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents
- EvoX: Meta-Evolution for Automated Discovery
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidence
- DS-STAR: Data Science Agent for Solving Diverse Tasks across Heterogeneous Formats and Open-Ended Queries
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- Exploration and Exploitation Errors Are Measurable for Language Model Agents
- Gemini: A Family of Highly Capable Multimodal Models
- InternAgent: When Agent Becomes the Scientist -- Building Closed-Loop System from Hypothesis to Verification
- HARPA: A Testability-Driven, Literature-Grounded Framework for Research Ideation
- AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks?
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems