Agents' Last Exam

Agents' Last Exam (ALE) is a benchmark designed to test AI agents on long-horizon, economically valuable real-world tasks. It moves beyond simple tests by using 1,490 expert-authored workflows drawn from professional industries defined by O*NET/SOC 2018. The goal is to measure if agents can achieve sustained performance in tasks that actually impact GDP, not just benchmark scores.

Open the full episode

More from AI Radio