Teaching Robots to Say 'I Don't Know': SENTINEL for Uncertainty-Aware SLAM
summary
The gist
Low-cost 2D LiDARs lack the intensity channels that more expensive sensors use to diagnose measurement failures…
In short
SENTINEL is a training-free reliability estimation framework for range-only LiDARs to diagnose measurement failures. It fuses geometric scan statistics with cross-modal depth consistency between LiDAR and an RGB-D camera to generate a reliability score. This allows the system to detect physical sensor failures, such as transparent surfaces, which standard systems miss.
Key concepts
- Geometric Score (Rgeo)
- This score is calculated from raw scan statistics using beam validity ratio and range variance. It measures the quality of the LiDAR scan based on how well individual beams are performing. A low Rgeo indicates poor geometric quality, often due to obstructions or sensor issues.
- Cross-Modal Consistency (Rcross)
- This signal is derived by projecting LiDAR ranges into a depth image and counting agreements between the two modalities. It checks if the LiDAR's range measurements align with what the camera perceives as depth. High consistency suggests both sensors agree on the environment's structure.
- SENTINEL Framework
- SENTINEL is a training-free method that fuses geometric scores and cross-modal consistency to produce a per-scan reliability score R. This score helps SLAM systems suppress corrupted scans when uncertainty is high, preventing silent map corruption from physical sensor failures.
- Sensor Independence Finding
- The study found that effective cross-modal reliability requires modalities that fail independently. Because the depth camera and LiDAR share an optical blind spot for infrared materials, this suggests future fusion systems should consider sensors with different failure modes.
Terminology used across episodes
This episode discusses
- Teaching Robots to Say 'I Don't Know': SENTINEL for Uncertainty-Aware SLAM · Paper Radio
- TOPGN: Real-time Transparent Obstacle Detection using Lidar Point Cloud Intensity for Autonomous Robot Navigation
The paper
Teaching Robots to Say 'I Don't Know': SENTINEL for Uncertainty-Aware SLAM · Read on arXiv
Abhishek S, Badrikanath Praharaj, Sreeram M.V
BuildMachineLabs
Low-cost 2D LiDARs lack the intensity channel that higher-end sensors use to diagnose measurement failures, yet they are widely used on educational and budget robotics platforms. We present SENTINEL, a training - free, label - free reliability estimation framework that gives range - only LiDAR an effective diagnostic signal. SENTINEL combines geometry-based scan statistics with cross - modal depth consistency between LiDAR and an RGB - D camera to compute a per - scan reliability score between 0 and 1. When the score falls below a threshold, corrupted scans are rejected and the robot falls back to calibrated wheel odometry, preventing silent SLAM corruption. We evaluate SENTINEL on a GEFIER R1 four - wheel skid-steer robot equipped with an RPLidar A2M12 and an Intel RealSense D435i in a 185 cm by 245 cm arena containing controlled transparent and reflective failure elements on a central obstacle. Spatial reliability maps across five surface conditions, including glass, mirror, shiny paper, and a mixed mirror and shiny-paper condition, show clear separation between clean and failure cases, allowing affected regions to be identified as reject or noise. Because these failure modes are absent in simulation, validation is performed entirely on real hardware.
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: We're looking at the paper: "Teaching Robots to Say 'I Don't Know'".
Dev: Here's the gist of the paper. Low-cost 2D LiDARs lack the intensity channels that more expensive sensors use to diagnose measurement failures, yet they are the default sensor on thousands of educational and budget robotics platforms.
Rosa: SENTINEL, a trainingfree, label-free reliability estimation framework that gives rangeonly LiDAR a diagnostic channel it does not natively possess.
Dev: The core problem addressed SLAM systems fail silently when sensor assumptions break, leading to confidently wrong pose estimates and phantom map structures with no error signal.
Rosa: A distinct category of failure is physical sensor failure where material properties cause the sensor to return structurally invalid data, such as transparent surfaces returning infinity or specular reflectors redirecting the beam.
Paper summary: Rosa: So wrapping up "Teaching Robots to Say 'I Don't Know': SENTINEL for Uncertainty-Aware SLAM," the authors are essentially showing how range-only LiDAR can be given a reliability metric without needing intensity channels.
Dev: They present this framework that fuses geometry based scan statistics with cross modal depth consistency to produce that score R between zero and one, and when R drops below a threshold, they suppress the corrupted scans and fall back to wheel odometry.
Taro: The key finding is the three point eight times separation between the clean condition minimum and the glass condition minimum in spatial reliability maps which proves it can detect physical failures <ref:2606.04853#pg3>.
Rosa: It’s about giving us a way to explicitly acknowledge perceptual uncertainty when that score R is below zero point three by suppressing corrupted scans and falling back to calibrated wheel odometry.
Rosa: The main implication is that for budget robotics platforms, adding a simple cross modal consistency check can provide a safety net against silent failures in SLAM.
Dev: It's about getting better at handling the uncertainty when the world misbehaves, not just running a faster loop rate or some other tuning adjustment.
Conclusion: Rosa: So we've been talking about SENTINEL, this framework that helps low cost range-only LiDAR systems know when they might be giving us bad data by using a cross modal check with a camera.
Dev: Yeah, it’s about that uncertainty awareness you get when the sensor assumptions break and the system starts giving us wrong pose estimates.
Rosa: The authors call it SENTINEL, and what’s really interesting is how they tackle the problem of those silent failures where a robot just keeps mapping a phantom structure without any error signal.
Dev: They show this reliability estimation framework that gives range-only LiDAR a diagnostic channel it doesn't have natively by fusing geometry stats with cross modal depth consistency.
Rosa: The big result they highlight is this separation, about three point eight times between the cleanest conditions and when you introduce things like glass surfaces into the map.
Dev: That separation proves it can actually detect those physical failures, like transparent surfaces returning infinity which would otherwise just confuse a standard SLAM system.
Rosa: It’s about explicitly acknowledging that uncertainty when that reliability score drops below zero point three, so the robot suppresses the bad scans and switches to wheel odometry.
Dev: That fallback is crucial for safety because it prevents silent map corruption and keeps the navigation stable while the system figures out what's actually happening.
Rosa: So, this means we’re moving towards systems that can be more honest about their own knowledge, even when using cheaper sensors on budget platforms.
Dev: It suggests a path forward where sensor fusion isn't just about combining data for accuracy but also for building a confidence score in what the robot is seeing.
Rosa: But there are still things to look at, like how they tuned those thresholds and what happens when you use modalities that fail together, which points us toward future work on learned thresholds and other ways to build this resilience.
More episodes
- 2608.13438-ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
- 2610.34593-Future Prediction as Training-Only Video Supervision for Pretrained VLA Policies
- 2610.35385-EmbodiedLab: Beyond Manipulation, Benchmarking Embodied Agents That Act to Know
- 2610.36378-Data-Driven Hamiltonian for Neural Optimal Control
- 2610.37275-A Heuristic for Scheduling Autonomous Vehicles at Intersections
- 2610.37288-Dynamic Coordination of Autonomous Vehicles at Intersections
- 2610.37632-Real-Time Coordination of Autonomous Vehicles at Intersections
- 2611.13779-Softness is something you also need! Why compliance helps control: information metrics of a passive walker with compliant ankle
- 2611.13411-Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees
- 2611.14488-Is Your Robot's Memory Just a Clock? Temporal Shortcuts in Memory-Augmented VLA Policies