IdeaAnchor: Teaching LLMs to Turn Literature into Research Ideas
cs.CL, cs.AI
Submitted: 2026-10-06
Updated: 2026-10-06
License: http://creativecommons.org/licenses/by/4.0/
The gist: Scientific research often begins by synthesizing ideas from a set of related papers to identify gaps and formulate new directions.
Abstract
Scientific research often begins by synthesizing ideas from a set of related papers to identify gaps and formulate new directions. However, training language models to perform this form of literature-grounded ideation remains challenging, as existing approaches based on prompting or feedback lack structured supervision for how papers should be synthesized. We introduce IdeaAnchor, a paradigm for training LLMs to perform research ideation using structured specifications as privileged signals. Each IdeaAnchor instance encodes how each input paper should be synthesized into a successful idea, including their functional roles, relationships, and target synthesis criteria. We build this paradigm by mining instances from published papers, capturing how real ideas emerge from prior literature. We then train models via demonstration, self-distillation, and reinforcement learning, and further enhance generation with retrieval at inference time. Experiments show consistent improvements in ideation quality. Our analysis reveals a functional decomposition: anchor-based training strengthens creative synthesis, retrieval enhances detail elaboration, and combining both yields the best performance.
Sources
- SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks
- MLGym: A New Framework and Benchmark for Advancing AI Research Agents
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
- Measuring the Gap Between Human and LLM Research Ideas
- Training AI Co-Scientists Using Rubric Rewards
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Sparks of Science: Hypothesis Generation Using Structured Paper Data
- Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Models
- Constitutional AI: Harmlessness from AI Feedback
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts
- WebGPT: Browser-assisted question-answering with human feedback
- Distilling the Knowledge in a Neural Network
- Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?
- ReAct: Synergizing Reasoning and Acting in Language Models
- Qwen3 Technical Report
- The Semantic Scholar Open Data Platform
- Language agents achieve superhuman synthesis of scientific knowledge
- RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human experts
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering