SWE-Together: Evaluating Coding Agents in Interactive User Sessions
SWE-Together is a new benchmark that tests coding agents as collaborators by measuring final code correctness and how many times they need corrective feedback during interaction. It reconstructs real user-agent sessions into reproducible tasks, allowing researchers to see how well different models work together in a multi-turn coding environment.