PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generation
cs.AI
Submitted: 2026-05-10
Updated: 2026-11-16
Code: https://github.com/YusanX/pde-agent-bench
Project page: https://zeroeclipse00.github.io/pde-agent-bench-github-pages
Terminology
Sources
- Evaluating Large Language Models Trained on Code
- Program Synthesis with Large Language Models
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- CodePDE: An Inference Framework for LLM-driven PDE Solver Generation
- OpenHands: An Open Platform for AI Software Developers as Generalist Agents
- SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
- Towards Multi-spatiotemporal-scale Generalized PDE Modeling
- CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamics
- SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Models
- RealPDEBench: A Benchmark for Complex Physical Systems with Real-World Data
- Automated Code Development for PDE Solvers Using Large Language Models
- Re4: Scientific Computing Agent with Rewriting, Resolution, Review and Revision
- PDE-Controller: LLMs for Autoformalization and Reasoning of PDEs
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- RACE-Bench: A Reasoning-Augmented Benchmark for Repository-Level Code Agents on Feature Addition
- PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Models
- Towards Scientific Intelligence: A Survey of LLM-based Scientific Agents
- Text-Trained LLMs Can Zero-Shot Extrapolate PDE Dynamics, Revealing a Three-Stage In-Context Learning Mechanism
- Datasheets for Datasets
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents