Can Failed Trajectories Reveal Where Agents Go Wrong? Agentic Failure Attribution Without Step-Level Labels
The paper addresses how to pinpoint which specific step caused an LLM agent's task failure when no step-level error labels are available. The proposed SOAP framework uses spectral scoring from failed trajectories combined with attention patterns to trace downstream error signals back to the most likely decisive, upstream mistake. This method is effective and requires no extra training data.