Beyond Task Reward: A Controller-Restriction Protocol for Evaluating Embodiment-Dependent Competence
cs.RO
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: 8 pages, 6 figures, 2 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Co-design methods optimize a robot's body and controller jointly and judge the result by one number, the task reward of the fully optimized pair.
Abstract
Co-design methods optimize a robot's body and controller jointly and judge the result by one number, the task reward of the fully optimized pair. That number cannot separate morphologies whose competence depends on the controller to very different degrees. We evaluate a morphology by restricting its controller instead, recording the task competence it retains under an explicitly declared, low-complexity controller family, environment, task and search budget. On three EvoGym locomotion tasks, task reward explains only 39%, 33% and 10% of the variance in this quantity, and geometric descriptors do not predict it under run-grouped cross-validation. The measurement is reliable across optimizer restarts (ICC (2,k) = 0.956 -- 0.986) but depends on the declared family: phasing the drive by actuator index instead of position ranks the same morphologies at Spearman 0.50 -- 0.63 and reverses reward-matched pairs. As a second search objective the axis improved competence at matched task reward in 3 of 5 paired runs, short of a pre-registered bar of 4. Used after an ordinary reward-only search instead, to choose within its top task-reward band, it selected a different body in all 8 runs offering a choice, at a cost of at most 0.10 reward units, and in 6 of 8 that body also scored higher under a held-out family. Restricted-control competence is therefore a reportable property of a co-designed morphology, interpretable only with the controller family that defines it.
Sources
- The Morphology-Control Trade-Off: Insights into Soft Robotic Efficiency
- Proximal Policy Optimization Algorithms
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies