From Optical Flow to Safety: Visual Safety Certification via Scale-Free Relative Motion

arXiv:2610.21374 · cs.RO, cs.SY, eess.SY · Submitted 2026-10-15 · Read on arXiv

cs.RO, cs.SY, eess.SY

Submitted: 2026-10-15

Updated: 2026-10-15

License: http://creativecommons.org/licenses/by-nc-nd/4.0/

The gist: Safe autonomous navigation using monocular vision remains challenging because explicit obstacle states are not directly observable.

Terminology

Abstract

Safe autonomous navigation using monocular vision remains challenging because explicit obstacle states are not directly observable. This letter introduces a visual safety-certification paradigm that uses scale-free, depth-normalized relative motion encoded by monocular optical flow as the representation for collision-risk certification, without reconstructing obstacle position, velocity, geometry, or a metric world model. Unlike conventional optical-flow-based navigation approaches that rely on image motion to shape avoidance behavior, the proposed framework directly encodes collision-cone geometry and safety constraints in this relative-motion representation. An online Concurrent Learning observer estimates the normalized relative velocity and provides a computable estimation-error bound. This uncertainty is propagated into the collision cone through angular inflation and a monocular robot-footprint margin, yielding a Robust Vision-Based Collision Cone Control Barrier Function (RV-C cubed BF). An optimal-decay CBF quadratic program minimally modifies the nominal control input to enforce the resulting robust safety constraint under the stated assumptions. Extensive simulation and real-world experiments on a TurtleBot3 in cluttered environments with static and dynamic obstacles demonstrate collision avoidance using only monocular vision and onboard proprioception, with the estimation-error bound containing the measured error in 98.3% of simulation samples and the robot achieving collision-free navigation in 93 of 100 real-world trials.

Related papers