Benchmarking Real-World Robotic Manipulation through Stochastic Challenges
cs.RO
Submitted: 2026-11-09
Updated: 2026-11-09
Code: https://github.com/rpl-bonn/stretch-compose
Terminology
Sources
- THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation
- RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies
- ManipulationNet: An Infrastructure for Benchmarking Real-World Robot Manipulation with Physical Skill Challenges and Embodied Multimodal Reasoning
- ManipBench: Benchmarking Vision-Language Models for Low-Level Robot Manipulation
- VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Tasks
- CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
- ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
- RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots
- BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation
- SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenes
- Real Robot Challenge: A Robotics Competition in the Cloud
- FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation
- RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies
- Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation