Autonomous Code Review: Hidden-Test Results on GitHub Issues
cs.SE
Submitted: 2026-11-06
Updated: 2026-11-06
Terminology
Sources
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
- SWR-Bench: Assessing LLM Performance in Real-World Code Review Comment Generation
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters