Beyond Surface Metrics: Multi-Condition Requirements in Enterprise Maintenance and AI Coding Benchmarks
cs.SE, cs.AI
Submitted: 2026-11-02
Updated: 2026-11-02
Terminology
Sources
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- SWE-PolyBench: A multi-language benchmark for repository level evaluation of coding agents
- SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
- Choosing Coding-Agent Benchmarks for Practice: Lessons from Task Demands and Agent Behaviour
- Evaluating Large Language Models Trained on Code
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters