LIBERO-Agent: Evaluating General-Purpose Agents for Direct Embodied Manipulation
This study tested general-purpose AI agents like GPT-6 Astra to see if they could perform robot manipulation tasks. The results show a reliability gap: agents are good at identifying targets and simple actions but struggle significantly with complex, multi-step physical tasks. Success depends on mastering both precise local movements and planning across many stages of a long task.