PAOLI: Pose-free Articulated Object Learning from Sparse-view Images
cs.CV
Submitted: 2025-09-04
Updated: 2026-09-19
License: http://creativecommons.org/licenses/by/4.0/
The gist: We present a method for modeling articulated objects from sparse images with unknown camera poses.
Terminology
Abstract
We present a method for modeling articulated objects from sparse images with unknown camera poses. Existing approaches require dense multi-view observations and ground-truth camera poses shared across articulation states, whereas our approach operates with as few as four unposed views per articulation state, without requiring ground-truth poses or shared cross-state calibration. The key challenge is that sparse-view reconstruction can recover each articulation state independently, but does not provide the cross-state correspondences required for part segmentation and kinematic reasoning. We address this by optimizing a dense deformation field that aligns independently reconstructed states and establishes dense correspondences across them. An iterative robust estimation procedure then separates static and moving parts and recovers their kinematic parameters. Finally, we refine geometry, appearance, and motion using self-supervised losses that enforce cross-view and cross-state consistency. Experiments on standard benchmarks and real-world examples show that our method produces accurate articulated object representations under substantially weaker input assumptions than prior work.
Sources
- UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views
- Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model
- NAP: Neural 3D Articulation Prior
- No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images
- Weak antilocalization and localization in Eu$_2$Ir$_2$O$_7$ (111) thin films by reactive solid phase epitaxy
- SAM 2: Segment Anything in Images and Videos
- OPDMulti: Openable Part Detection for Multiple Objects
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models