Critic Architecture Matters: Dual vs. Unified Critics for Humanoid Loco-Manipulation
The episode discusses a paper titled "Critic Architecture Matters" concerning dual versus unified critics for humanoid robot locomotion and manipulation. The hosts discuss how unified critics can let locomotion rewards dominate, leading to suboptimal arm actions. They conclude that separate critics offer better trade-offs and efficiency, suggesting designers should treat critic architecture as a critical design variable.