SRHarness: A Harness for Agentic Symbolic Regression
cs.AI, cs.LG, cs.SC
Submitted: 2026-09-28
Updated: 2026-09-28
Code: https://github.com/tsinghua-fib-lab/SRHarness
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Recent agentic symbolic regression approaches increasingly rely on large language models to analyze data, select scientific operations, and refine hypotheses over long search trajectories.
Terminology
Abstract
Recent agentic symbolic regression approaches increasingly rely on large language models to analyze data, select scientific operations, and refine hypotheses over long search trajectories. In such systems, performance depends not only on the underlying model and search strategy, but also on the runtime infrastructure that supports scientific search. We introduce SRHarness, a domain-specific harness for agentic symbolic regression built around three mechanisms: composable scientific actions that provide a common interface over raw, transformed, and candidate-derived quantities; persistent scientific state that retains evaluated hypotheses and exposes compact model-facing views; and trajectory lifecycle management that coordinates continuation, branching, restart, and termination. On LLM-SRBench, SRHarness consistently improves both numerical generalization and symbolic recovery under matched LLM backbones. With DeepSeek-v4-flash-0731, it achieves 93.69% symbolic accuracy on LSR-Transform, compared with 62.16% for SR-Scientist, and retains 72.97% accuracy on an anonymized variant that removes scientific descriptions and variable semantics, versus 39.64% for SR-Scientist. Under the same DeepSeek-v4-flash-0731 backbone, SRHarness also substantially outperforms Codex (72.97% vs. 20.72%) and reaches performance comparable to Codex with GPT-5.5, while simply providing Codex with the same scientific tools does not reproduce this advantage. These results show that effective agentic symbolic regression depends not only on models or tools, but also on structured runtime support for organizing scientific actions, accumulated hypotheses, and long-horizon search.
Sources
- Interpretable Machine Learning for Science with PySR and SymbolicRegression.jl
- Programmatic Context Augmentation for LLM-based Symbolic Regression
- LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery
- Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark
- Influence-Guided Symbolic Regression: Scientific Discovery via LLM-Driven Equation Search with Granular Feedback
- LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models
- MOT-SR: Multi-Objective Tool-Augmented Scientific Equation Discovery with Large Language Models
- DrSR: LLM based Scientific Equation Discovery with Dual Reasoning from Data and Experience
- Language models guide symbolic equation discovery by controlling search
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Think like a Scientist: Physics-guided LLM Agent for Equation Discovery
- GLM-5: from Vibe Coding to Agentic Engineering
- Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation
- Building Agent Harnesses for Scientific Curation from Multimodal Sources
- Stop Comparing LLM Agents Without Disclosing the Harness
- General Modular Harness for LLM Agents in Multi-Turn Gaming Environments
- A-SR: Self-Evolving Agentic LLMs for Symbolic Regression via Hierarchical Coordination
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems