Take It From Here: Evaluating Coding Agents On Project Takeover
cs.SE, cs.MA
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- Program Synthesis with Large Language Models
- Evaluating Large Language Models Trained on Code
- Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
- SWE-Bench-CL: Continual Learning for Coding Agents
- SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
- A Scalable Benchmark for Repository-Oriented Long-Horizon Conversational Context Management
- ProjDevBench: Benchmarking AI Coding Agents on End-to-End Project Development
- RigorBench: Benchmarking Engineering Process Discipline in Autonomous AI Coding Agents
- RECODE-H: A Benchmark for Research Code Development with Interactive Human Feedback
- SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks
- LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleagues
- SR-Eval: Evaluating LLMs on Code Generation under Stepwise Requirement Refinement
- A Unified Issue Resolution Benchmark for Requirement Clarification, Planning, and Code Generation for Coding Agents
- SWE Context Bench: A Benchmark for Context Learning in Coding
- ContextBench: A Benchmark for Context Retrieval in Coding Agents
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters