Cross-Visibility-Gap Identity Persistence for 4D Scene Graphs

arXiv:2610.27505 · cs.CV, cs.AI · Submitted 2026-10-20 · Read on arXiv

cs.CV, cs.AI

Submitted: 2026-10-20

Updated: 2026-10-20

Comments: 8 pages, 2 figures

License: http://creativecommons.org/licenses/by/4.0/

The gist: 4D scene graphs require persistent object identity when an object disappears inside an opaque carrier and later reappears as a fresh detection.

Abstract

4D scene graphs require persistent object identity when an object disappears inside an opaque carrier and later reappears as a fresh detection. When appearance and target-centric motion are unavailable, identity recovery must rely on relational history. We formulate cross-visibility-gap identity persistence as historical-node recovery through a remembered target--carrier binding. We introduce CVG-SGM, a perception-frontend-compatible transfer--maintain--read memory. Geometry-weighted cross-node interaction transfers target-specific evidence into carrier states, a shared per-node GRU maintains this information during transport, and a two-time readout combines stored carrier--identity compatibility with current detection--carrier geometry to recover the historical identity. In the controlled one-identity-per-carrier setting, CVG-SGM achieves 1.000 re-link accuracy, compared with 0.570 for both no-memory and parameter-count-matched no-write controls. It also generalizes to scene-disjoint, unseen longer visibility gaps. On real RGB-D/SAM2 feature-level episodes, it correctly re-links 36/36 held-out detections, compared with 28/36 for the strongest fixed carrier--identity control. Counterfactual carrier-memory swaps redirect predictions according to the swapped bindings, supporting the role of stored relational information in identity recovery. The current approach remains limited by shared-carrier identity ambiguity and does not provide end-to-end raw-video re-identification.

Related papers