Coupled Particle Filters for Robust Affordance Estimation
cs.RO
Submitted: 2026-03-16
Updated: 2026-03-16
Comments: Accepted to IEEE International Conference on Robotics and Automation (ICRA) 2026
Journal ref: 2026 IEEE International Conference on Robotics and Automation (ICRA), pp. 1783-1790
DOI: 10.1109/ICRA57385.2026.11697141
Code: https://github.com/tu-rbo/CoupledParticleFilters
License: http://creativecommons.org/licenses/by/4.0/
The gist: Robotic affordance estimation is challenging due to visual, geometric, and semantic ambiguities in sensory input.
Terminology
Abstract
Robotic affordance estimation is challenging due to visual, geometric, and semantic ambiguities in sensory input. We propose a method that disambiguates these signals using two coupled recursive estimators for sub-aspects of affordances: graspable and movable regions. Each estimator encodes property-specific regularities to reduce uncertainty, while their coupling enables bidirectional information exchange that focuses attention on regions where both agree, i.e., affordances. Evaluated on a real-world dataset, our method outperforms three recent affordance estimators (Where2Act, Hands-as-Probes, and HRP) by 308%, 245%, and 257% in precision, and remains robust under challenging conditions such as low light or cluttered environments. Furthermore, our method achieves a 70% success rate in our real-world evaluation. These results demonstrate that coupling complementary estimators yields precise, robust, and embodiment-appropriate affordance predictions.
Sources
Related papers
- Rethinking Actions: Continuity-Aware Priors for World-Model Planning
- MOSAIC: Modular Obstacle and Spatial-Aware Framework for Manipulation In Cluttered Scenes
- SAGAS: Semantic-Aware Graph-Assisted Stitching for Offline Temporal Logic Planning
- DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
- LaST0.5: A Generalist World Action Model with Interaction-Centric Latent Reasoning
- CIALLO: Learning Shared Intent Representations for Cross-Embodiment Manipulation