Training Numerical Intelligence via Auto-Diagnosis and Skill Discovery
cs.AI, cs.CL, cs.LG
Submitted: 2026-10-02
Updated: 2026-10-02
Comments: 20 pages
License: http://creativecommons.org/licenses/by/4.0/
The gist: AI agents are becoming increasingly capable of generating scientific code, but generating code is not the same as improving the algorithms behind it.
Abstract
AI agents are becoming increasingly capable of generating scientific code, but generating code is not the same as improving the algorithms behind it. For numerical solvers, execution feedback can expose poor performance, but rarely reveals its underlying cause and how to address it. We introduce Auto-Diagnosis and Skill Discovery (ADSD), a framework that links numerical diagnosis to reusable solver self-improvement. ADSD follows a diagnosis-first paradigm that first explains why a solver performs poorly, then uses this diagnosis to guide the discovery of appropriate numerical methods. The resulting knowledge is packaged into reusable solver skills, turning solver improvement from trial-and-error editing into a structured process of diagnosis, discovery, and implementation. Across four challenging numerical domains--power flow equation, AC optimal power flow control, stiff ordinary differential equations, and heterogeneous diffusion PDEs--ADSD consistently improves solver accuracy, robustness, and efficiency. On GOC-500 power flow, for example, ADSD reduces mean solver error by nearly 71 times, with improvements further transferring to unseen grid topologies and operating regimes.
Sources
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- SciML Agents: Write the Solver, Not the Solution
- Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agents
- Grid-Mind: An LLM-Orchestrated Multi-Fidelity Agent for Automated Connection Impact Assessment
- Reinforcement Learning with Verifiable Physics: Post-training LLMs with Continuous Rewards
- SkillForge: Forging Domain-Specific, Self-Evolving Agent Skills in Cloud Technical Support
- GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agents
- EvoSkill: Automated Skill Discovery for Multi-Agent Systems
- SkillRevise: Improving LLM-Authored Agent Skills via Trace-Conditioned Skill Revision
- SkillCAT: Contrastive, Assessment-Augmented and Topology-AwareSkill Self-Evolution for LLM Agents
- AgentRx: Diagnosing AI Agent Failures from Execution Trajectories
- ConDiff: A Challenging Dataset for Neural Solvers of Partial Differential Equations
- OPFData: Large-scale datasets for AC optimal power flow with topological perturbations
- Large Foundation Models for Power Systems
- GAIA -- A Large Language Model for Advanced Power Dispatch
- ElecBench: a Power Dispatch Evaluation Benchmark for Large Language Models
- Enabling Large Language Models to Perform Power System Simulations with Previously Unseen Tools: A Case of Daline
- Fault Diagnosis in Power Grids with Large Language Model
- LLM-DMD: Large Language Model-based Power System Dynamic Model Discovery
- From Natural Language to Solver-Ready Power System Optimization: An LLM-Assisted, Validation-in-the-Loop Framework
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems