ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis
The episode discusses 'ATBench,' a benchmark for evaluating AI agent safety and diagnosis. Hosts discuss how ATBench moves beyond simple testing by introducing a detailed taxonomy—Risk Source, Failure Mode, and Real-world Harm—to pinpoint the root cause of failures. This shifts AI safety from isolated checks to continuous, systemic resilience.