GRF-Recon: Global Ray-Field Optimization for Long-Sequence Feed-forward Reconstruction

arXiv:2609.20012 · cs.CV · Submitted 2026-09-17 · Read on arXiv

cs.CV

Submitted: 2026-09-17

Updated: 2026-09-17

Comments: Accepted to ECCV 2026 as a Spotlight presentation

License: http://creativecommons.org/licenses/by/4.0/

The gist: Feed-forward 3D reconstruction provides an efficient paradigm for scene modeling from image sequences.

Terminology

Abstract

Feed-forward 3D reconstruction provides an efficient paradigm for scene modeling from image sequences. Scaling these models to large monocular scenarios are constrained by excessive GPU memory footprint, degraded local geometry, and long-term trajectory drift. Existing chunk-based optimization strategies provide limited geometric constraints and fail to maintain global consistency over extended trajectories. We present a unified framework for stable and scalable feed-forward 3D reconstruction from long monocular sequences. Our approach builds on coarse-to-fine trajectory alignment augmented by lightweight geometric prior injection. Distilling monocular geometric cues into the feed-forward backbone via LoRA adaptation improves depth accuracy on fine structures while preserving inference efficiency. We introduce a hybrid-weight sparse ray-field optimization that leverages high-frequency geometric features to guide local point-cloud refinement and enforce consistent inter-frame ray constraints. Unlike prior chunk-based methods, this establishes strong cross-frame geometric coupling while maintaining scalability. Finally, an efficient trajectory stitching strategy with joint ray-error optimization explicitly reduces accumulated drift. Extensive experiments show that our approach achieves competitive trajectory accuracy compared with representative SLAM systems, while maintaining globally consistent 3D reconstruction in large-scale scenarios.

Sources

Related papers