MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
MIKASA-Robo-VLA is a rigorous benchmark testing how vision-language models handle memory during long manipulation tasks. It includes 90 tasks across 26 families, requiring models to retain various memory types like objects and spatial locations over episodes up to 2,160 steps.