Learning Scientific Exploration from Human Research Decision Trajectories
cs.LG, cs.CL
Submitted: 2026-10-05
Updated: 2026-10-05
Code: https://github.com/xuchengong/researchtrails
License: http://creativecommons.org/licenses/by/4.0/
The gist: A key challenge in building AI systems for scientific research is enabling scientific exploration: the systematic process of investigating unknown phenomena or ideas to gain new knowledge through
Abstract
A key challenge in building AI systems for scientific research is enabling scientific exploration: the systematic process of investigating unknown phenomena or ideas to gain new knowledge through sequences of research decisions and actions. Yet this process is largely missing from existing scientific corpora; for example, research papers primarily record final outcomes rather than the trajectories that produced them. In this work, we introduce ResearchTrails, a dataset of human research trajectories constructed from Git repositories, where commit histories serve as proxies for research exploration. We develop an automated and scalable pipeline that extracts structured research trajectories from repository commits, capturing successive changes to methods, experiments, and ablations. We characterize the resulting dataset and show that these trajectories contain meaningful signals about intermediate research decisions beyond what final papers reveal. We further demonstrate utilities of ResearchTrails in multiple use cases, including retrieving human research experience as external skills at test time and training models on research trajectories to improve generalization to new research decisions. Our results suggest a path toward AI systems that learn not only from the products of science, but from the evolving process of discovery itself.
Sources
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
- AI Scientist via Synthetic Task Scaling
- Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills
- ResearchGym: Evaluating Language Model Agents on Real-World AI Research
- Training AI Co-Scientists Using Rubric Rewards
- Accelerating scientific discovery with Co-Scientist
- GIANTS: Generative Insight Anticipation from Scientific Literature
- LoRA: Low-Rank Adaptation of Large Language Models
- MLAgentBench: Evaluating Language Agents on Machine Learning Experimentation
- Scientific Agent Skills: A Library of Procedural Knowledge for Research Agents
- The Semantic Scholar Open Data Platform
- ScholaWrite: A Dataset of End-to-End Scholarly Writing Process
- HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generation
- Sci-Reasoning: A Dataset Decoding AI Innovation Patterns
- ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewing
- ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decomposition
- Understanding R1-Zero-Like Training: A Critical Perspective
- Decoupled Weight Decay Regularization
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- MLGym: A New Framework and Benchmark for Advancing AI Research Agents
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks