Patch correctness in automated program repair: A five-dimensional evidence framework and cross-benchmark audit from classical repair to coding agents
cs.SE
Submitted: 2026-11-07
Updated: 2026-11-07
Terminology
Sources
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- SWE-ABS: Adversarial Benchmark Strengthening Exposes Inflated Success Rates on Test-based Benchmark
- A Survey of LLM-based Automated Program Repair: Taxonomies, Design Paradigms, and Applications
- Software Development Life Cycle Perspective: A Survey of Benchmarks for Code Large Language Models and Agents
- TDD-Bench Verified: Can LLMs Generate Tests for Issues Before They Get Resolved?
- Investigating Test Overfitting on SWE-bench
- SWEPatchTest: Evaluating Software Tests Beyond Reproduction
- SWE-bench Goes Live!
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters