Built on Broken Assumptions (BOBA): Why Coding Agents Cannot Be Left Alone
cs.SE, cs.LG
Submitted: 2026-11-01
Updated: 2026-11-01
Code: https://github.com/MoonshotAI/Kimi-K3
Terminology
Sources
- From Confident Closing to Silent Failure: Characterizing False Success in LLM Agents
- SWE-Bench+: Enhanced Coding Benchmark for LLMs
- SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents
- SWE-rebench V2: Language-Agnostic SWE Task Collection at Scale
- SWE-CI: Evaluating Agent Capabilities in Maintaining Codebases via Continuous Integration
- Evaluating Large Language Models Trained on Code
- Teaching Large Language Models to Self-Debug
- SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agents
- SWE-Milestone: Evaluating AI Agents on Continuous Software Evolution
- SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
- These Aren't the Reviews You're Looking For How Humans Review AI-Generated Pull Requests
- daVinci-Env: Open SWE Environment Synthesis at Scale
- Human Oversight and Overload: Two Hidden and Costly Burdens of AI-Assisted Software Engineering
- DeepSWE: Measuring Frontier Coding Agents on Original, Long-Horizon Engineering Tasks
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
- ChainSWE: Benchmarking Coding Agents on Multi-Bug Software Maintenance
- Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering
- LLMs Get Lost In Multi-Turn Conversation
- SWE-Chain: Benchmarking Coding Agents on Chained Release-Level Package Upgrades
- SWE-EVO: Benchmarking Coding Agents in Long-Horizon Software Evolution Scenarios
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters