Do Coding Agents Deceive Us? Detecting and Preventing Cheating via Capped Evaluation with Randomized Tests

arXiv:2606.07379 · cs.LG, cs.AI, cs.CL, stat.ME · Submitted 2026-06-05 · Read on arXiv

cs.LG, cs.AI, cs.CL, stat.ME

Submitted: 2026-06-05

Updated: 2026-11-16

Code: https://github.com/harbor-framework/harbor

Project page: https://debugml.github.io/cheating-agents

Terminology

Sources

Related papers