How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudes
hep-th, cs.AI
Submitted: 2026-09-30
Updated: 2026-09-30
Comments: 22+26 pages, 10 figures
Code: https://github.com/ZihanZhou26/hydrotope_benchmark
License: http://creativecommons.org/licenses/by/4.0/
The gist: We study how AI agents discover and validate scientific formulas using a controlled case study of the hydrotope, a recently discovered geometric formula that combines the different polynomial pieces
Terminology
Abstract
We study how AI agents discover and validate scientific formulas using a controlled case study of the hydrotope, a recently discovered geometric formula that combines the different polynomial pieces of nonlinear surface-wave scattering into one global expression. This problem is deceptively difficult: simple formulas can hold within individual frequency regions, but the global result must identify their boundaries and combine exponentially many potentially active terms. We reconstruct how the formula was originally discovered through human--agent collaboration and analyze 18 single-prompt rediscovery runs under no hint and two forms of human guidance: a false hint representing an incorrect prior and a true hint representing domain-informed insight. Only four recover the formula across all kinematic chambers (i.e., regions in which a single polynomial form applies), while most unsuccessful runs find correct chamber polynomials but fail to combine them or test their full domain. Conventional and LLM-assisted symbolic regression and standard machine-learning regressors likewise fail to recover the global formula in our experiments. Guided by these failure modes, we test a PI + two-student workflow in which a coordinating lead agent assigns complementary analytic and numerical tasks to two research agents and independently evaluates their results. The PI + two-student team successfully rediscovers the complete hydrotope formula, while the same workflow applied to the harder three negative wavenumber problem discovers a new independent verified analytic expression for the six-point amplitude A 6.
Sources
- Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl
- Improving Factuality and Reasoning in Language Models through Multiagent Debate
- Symbolic Regression with a Learned Concept Library
- BLADE: Benchmarking Language Model Agents for Data-Driven Science
- Single-minus gluon tree amplitudes are nonzero
- Large Language Model based Multi-Agents: A Survey of Progress and Challenges
- Unified remnant models for aligned-spin, precessing, and eccentric binary black hole mergers
- Discovery of Interpretable Surrogates via Agentic AI: Application to Gravitational Waves
- End-to-end symbolic regression with transformers
- AgentBench: Evaluating LLMs as Agents
- KAN: Kolmogorov-Arnold Networks
- Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discovery
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs
- Toolformer: Language Models Can Teach Themselves to Use Tools
- Resummation of the C-Parameter Sudakov Shoulder Using Effective Field Theory
- LLM-SR: Scientific Equation Discovery via Programming with Large Language Models
- STRIDE: A Self-Reflective Agent Framework for Reliable Automatic Equation Discovery
- DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience
- SR-Scientist: Scientific Equation Discovery With Agentic AI
Related papers
- S-duality, boundary states, and higher-form symmetries on ALE spaces
- Quantum simulation of traversable-wormhole-inspired quantum teleportation in a chaotic binary sparse SYK model
- Perfect Particle Transmission through Duality Defects
- Entanglement Wedge Reconstruction Beyond the Large N Limit via the Twirled Petz Map
- Horizons and Soft Quantum Information
- Energy Transmission Across Holographic Conformal Interfaces in General Dimensions