LabBook: Harnessing Experimental History for Efficient LLM-Driven Discovery
cs.LG, cs.AI
Submitted: 2026-09-30
Updated: 2026-09-30
Comments: Under Review
Code: https://github.com/BoYuanVisionary/LabBook
License: http://creativecommons.org/licenses/by/4.0/
The gist: Evolutionary approaches to LLM-driven discovery often generate new programs from a small set of selected ancestors.
Abstract
Evolutionary approaches to LLM-driven discovery often generate new programs from a small set of selected ancestors. This keeps contexts manageable but can omit useful evidence from other experiments, whereas including the full experimental history produces long, redundant contexts. We introduce a simple, single-agent discovery harness built around LabBook, an agent-maintained memory that serves two complementary roles: guiding retrieval of relevant evidence from a complete experimental log and informing the generation of new solutions. At each iteration, the same agent combines its memory with retrieved evidence and jointly produces the next program and an updated LabBook. This separates complete history retention from selective context construction, without requiring an explicit population or branching search structure. On 49 Frontier-CS problems, LabBook improves the observed quality-cost trade-off over the evaluated evolutionary baselines with two backbones, while remaining competitive across nine additional mathematical, systems, and heuristic-design tasks. Code will be released at https://github.com/BoYuanVisionary/LabBook.
Sources
- CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimization
- AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimization
- CausalEvolve: Towards Open-Ended Discovery with Causal Scratchpad
- Barbarians at the Gate: How AI is Upending Systems Research
- DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolution
- EvoX: Meta-Evolution for Automated Discovery
- FrontierCS: Evolving Challenges for Evolving Intelligence
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- MemGPT: Towards LLMs as Operating Systems
- RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experience
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Dream-RSI: Recursive Self-Improvement through Evolving Worlds
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks