CR-Bench-v2: Evaluating the Real-World Utility of AI Code Review Agents
cs.SE, cs.LG
Submitted: 2026-11-02
Updated: 2026-11-03
Code: https://github.com/resources/articles
Terminology
Sources
- A Comprehensive Study on Deep Learning Bug Characteristics
- Automating Code Review Activities by Large-Scale Pre-training
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- gpt-oss-120b & gpt-oss-20b Model Card
- Harnessing Large Language Models for Curated Code Reviews
- Reflexion: Language Agents with Verbal Reinforcement Learning
- OpenAI GPT-5 System Card
- A Roadmap on Modern Code Review: Challenges and Opportunities
- SWR-Bench: Assessing LLM Performance in Real-World Code Review Comment Generation
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters