Contact-Aided Factor-Graph Localization for Underwater Sampling

summary

The gist

Accurate state estimation for autonomous underwater vehicles performing close-range seafloor sampling remains challengingIn low-altitude operation…

In short

The paper proposes a Contact-Aided Factor-Graph Localization framework for autonomous underwater vehicles sampling seafloor objects. It uses physical contact with an object as a reliable geometric constraint to overcome localization challenges caused by poor underwater vision. This method significantly reduces trajectory drift and improves the accuracy of object revisit in challenging, perception-degraded environments.

Key concepts

Contact-Aided FactorGraph Localization
This is a method that estimates the vehicle's position by combining multiple sensor measurements (like IMU and DVL) with new information gained from physical contact. When the vehicle touches an object, this interaction provides a strong, metric geometric anchor that helps stabilize the estimation process.
Planar Visual Degeneracy
This occurs when a camera looking down onto a flat seafloor cannot determine its precise position because the scene lacks unique features or depth cues. The framework addresses this by using adaptive uncertainty scaling to ensure the visual estimates remain consistent even when visual information is weak.
Contact-Induced Geometric Anchoring
When the vehicle's manipulator makes suction contact with a benthic object, it creates a fixed point in space relative to the vehicle. This contact acts like an implicit loop closure, providing high-confidence geometric constraints that correct accumulated drift without needing explicit visual landmarks.
Factor Graph Localization
This is a mathematical approach to state estimation where the system models the vehicle's position and sensor measurements as interconnected factors in a graph. The framework uses this to tightly fuse data from inertial sensors, visual observations, and physical contact constraints into one consistent estimate.

Terminology used across episodes

This episode discusses

The paper

Contact-Aided Factor-Graph Localization for Underwater Sampling · Read on arXiv

School of Engineering & Physical Sciences, Heriot-Watt University of Edinburgh and Engineering Department, Japan Agency for Marine-Earth Science and Technology

Accurate state estimation for autonomous underwater vehicles performing close-range seafloor sampling remains challenging. In low-altitude operation, down-looking cameras over featureless planar seabeds produce scale ambiguity, lateral degeneracy, and inconsistent feature tracking. Meanwhile, inertial-Doppler Velocity Log (DVL) fusion alone provides no mechanism for structural drift correction. We propose a Contact-Aided Factor-Graph Localization framework that treats physical interaction as an informative geometric constraint within a smoothing-based localization formulation. The method tightly fuses suction-based manipulator contact events with adaptive visual odometry, learned object detections, and on-board sensors. Visual odometry relative-pose factors and landmark bearing-range factors are uncertainty-scaled according to inlier statistics to prevent visually weak frames from destabilizing the estimator, while contact events are modeled as high-confidence factors that induce implicit loop closures without appearance-based place recognition. Furthermore, the system can fully initialize online during motion. Experimental evaluation in tanks, harbor, and simulation environments demonstrates that contact-induced constraints significantly reduce trajectory drift and improve object revisit accuracy compared to filtering-based navigation and contact-free graph formulations. These results highlight the role of embodied physical interaction as a localization primitive in perception-degraded underwater environments

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: I'm Rosa.

Dev: And I'm Dev, here with Taro.

Rosa: We're looking at the paper: "Contact-Aided Factor-Graph Localization for Underwater Sampling".

Dev: Here's the gist of the paper. Accurate state estimation for autonomous underwater vehicles performing close-range seafloor sampling remains challengingIn low-altitude operation, down-looking cameras over featureless planar seabeds produce scale ambiguity, lateral degeneracy, and inconsistent feature trackingWe propose a Contact-Aided Factor-Graph Localization framework that treats physical interaction as an informative geometric constraint within a smoothing-based localization formulationExperimental evaluation in tanks, harbor, and simulation environments demonstrates that contact-induced constraints significantly reduce trajectory drift and improve object revisit accuracy compared to filtering-based navigation and contactfree graph formulationsThese results highlight the role of embodied physical interaction as a localization primitive in perception-degraded underwater environments Core Problem Definition Autonomous underwater vehicles (AUVs) performing close-range seafloor sampling operate in severely perceptiondegraded conditionsGPS is unavailable, and navigation relies on inertial–DVL dead reckoning, which accumulates driftUnderwater imagery suffers from scattering, turbidity, low texture, and photometric distortionThe scene is predominantly planar and texture-sparse, rendering monocular visual odometry geometrically ill-conditionedAccurate localization is essential for object approach, suction-based grasping, and repeated samplingThe core challenge is therefore how to obtain structurally informative constraints in environments where conventional exteroceptive sensing is weakWe propose to treat physical interaction as a localization primitiveWhen the AUV establishes suction contact with a benthic object, the end-effector creates a metrically grounded, viewpoint-invariant geometric constraintWe introduce a Contact-Aided FactorGraph Localization framework that tightly fuses IMU, DVL, pressure, and magnetometer measurements with adaptive down-looking visual odometry and manipulator contact constraintsThe system addresses three challenges: Planar visual degeneracy by using adaptive uncertainty scaling to mitigate estimator inconsistency under weak monocular geometryDrift without natural loop closures is mitigated by formulating suction contact as a high-confidence geometric factor that induces implicit loop closureA hybrid slidingwindow strategy alternates between landmarkaugmented and pose-only refinement to preserve real-time robustness against intermittent visual structure Sensor Fusion and Constraint Modeling The framework formulates underwater state estimation as a contact-aided smoothing problem on a factor graph, implemented using GTSAMVehicle poses, velocities, IMU biases, and environmental landmarks are jointly estimated by fusing proprioceptive navigation measurements with visual observations and manipulator contact constraints within a unified probabilistic frameworkThe inertial sensors provide a tightly coupled backbone where IMU preintegration links consecutive states using the formula (3)The DVL provides a velocity factor by incorporating body-frame velocity corrected for rotational motionPressure measurements are fused as a prior on the vertical position using the temperature-compensated density modelThe visual odometry pipeline employs contrast enhancement and ORB feature extraction, with metric scale recovered from auxiliary sensors like DVL or pressureVisual uncertainty is adaptively scaled using the inlier ratio to prevent visually weak frames from destabilizing the estimator Contact-Induced Geometric Anchoring The manipulator-based contact sensing treats the end-effector as a proprioceptive sensor providing contact-based geometric constraints through a suction end-effectorWhen the suction cup engages, the current position of the end-effector pee is calculated and treated as a point measurement in the environmentIf an existing landmark lj lies within a proximity threshold, a bearing–range factor is added between the current pose xk and the landmarkThis mechanism yields an implicit loop closure when the end-effector contacts a previously mapped object without requiring explicit place recognitionThe manipulator thus acts as an active tactile sensor, providing sparse but high-confidence constraints that stabilize the factor graph during prolonged low-visibility operation Experimental Validation and Results In the first tank experiments, introducing two 180◦ rotations increases ATE to 0.2917 m and yaw RMSE to 0.1232 rad due to weak lateral and heading observabilityAdding a starfish landmark during rotation improves yaw stability (0.0867 rad) but further increases ATE (0.3514 m), indicating that a single visual landmark does not resolve global planar degeneracyThe combination of depth variation and landmark constraints yields the best performance with ATE 0.1651 m and yaw RMSE 0.0412 radIn the harbor deployment, task-level revisit accuracy improves from 1.23 m without landmarks to 0.90 m when pump activation events are includedThis reduction demonstrates that contact-induced constraints provide structurally informative corrections even under visually degraded conditions We presented a contact-aided factor-graph framework in which physical interaction helps resolve degeneracy in perception-limited underwater SLAMStructured motion and deliberate physical interaction introduce metrically anchored constraints that improve consistency where manipulation occursThis trend also holds in harbor conditions, where turbidity and illumination variability increase global ATE, but relative pose errors remain low and contact events provide repeatable correctionsDrift in perception-limited underwater missions is not only a sensing problem, but an observability problemFuture work will extend this framework toward dense, mission-time mapping by coupling contact-aided localization with high-rate volumetric approaches such as FRAGG-MAP to enable drift-aware reconstruction of benthic workspaces for occupancy and manipulation planning REFERENCES

1: M.

Rosa: Ferrera, J.

Dev: Moras, P.

Rosa: Trouve-Peloux, and V.

Paper summary: Rosa: We just talked about the core idea of this paper, "Contact-Aided Factor-Graph Localization for Underwater Sampling," which is using physical contact to anchor localization constraints in environments where visual and inertial sensors are weak.

Dev: Right, so the authors propose a Contact-Aided FactorGraph Localization framework that treats physical interaction as an informative geometric constraint inside a smoothing formulation. They are fusing suction-based manipulator contact events with adaptive visual odometry and other on board sensors to estimate the state of the underwater vehicle.

Taro: From what I see, they're tackling three main things: first, planar visual degeneracy using adaptive uncertainty scaling to handle those weak monocular geometries; second, drift without natural loop closures by making suction contact a high-confidence geometric factor; and third, maintaining real-time robustness with a hybrid sliding window strategy that alternates between landmark augmented and pose only refinement.

Rosa: That adaptive scaling sounds like a smart way to manage the visual uncertainty when the visual features are sparse or bad.

Dev: And modeling contact as a high-confidence factor is what’s really compelling because it creates implicit loop closures that correct drift without needing explicit place recognition.

Conclusion: Rosa: So, looking at the full scope of "Contact-Aided Factor-Graph Localization for Underwater Sampling," the authors argue that structured motion and deliberate physical interaction introduce metrically anchored constraints that improve consistency precisely when manipulation is happening.

Dev: And they’ve shown this trend holds in harbor conditions too, where things like turbidity and lighting variability might increase global absolute translational error, but their relative pose errors stay low, and those contact events provide repeatable corrections.

Taro: It seems the main implication is that drift in perception-limited underwater missions isn't just a sensing problem anymore; it’s fundamentally an observability problem that can be solved by incorporating physical interaction as a localization primitive.

Rosa: Exactly. This approach moves beyond just looking for visual features to using the vehicle's physical actions to ground the estimation of its position, which is crucial for future work involving drift-aware reconstruction for occupancy and planning.

More episodes

← Home