MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment
summary
The gist
Underground mines present extreme conditions for autonomous robot navigation: GPS is denied, lighting is degraded…
In short
MineXplore is an open-source navigation benchmark built for autonomous robots in underground mines where GPS fails and lighting is poor. It uses a realistic 3D model derived from a Chilean copper mine dataset to test reinforcement learning policies. A single agent trained with PPO achieved stable exploration, proving the environment supports reproducible policy learning under harsh, realistic sensing conditions.
Key concepts
- MineXplore
- A simulation environment built in MuJoCo that mimics a real underground mine. It reconstructs a complex 104,423 m2 tunnel network using LiDAR data and includes features like varying floor friction, periodic spot lighting, and a global incline to simulate extreme conditions.
- Contour-to-MJCF Pipeline
- A six-stage process used to convert raw mine survey data (like 2D plans and LiDAR point clouds) into the 3D geometry format required by MuJoCo. This pipeline handles everything from scaling measurements to creating complex, jagged wall surfaces for accurate simulation.
- Reward Structure
- The system uses a specific reward function designed to encourage active exploration rather than just reaching a goal. The agent is rewarded based on newly discovered cells ($\Delta c \cdot g$) and penalized for collisions, ensuring the learned policy focuses on mapping unknown areas of the tunnel.
- PPO Baseline
- Proximal Policy Optimization (PPO) is a specific type of reinforcement learning algorithm used to train the robot agent. It was used here to test if an RL policy could successfully navigate and explore the complex MineXplore environment without catastrophic failures.
Terminology used across episodes
This episode discusses
- MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment · Paper Radio
- MuJoCo Playground
- Proximal Policy Optimization Algorithms
- Gymnasium: A Standard Interface for Reinforcement Learning Environments
The paper
MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment · Read on arXiv
Abhishek S, Badrikanath Praharaj, Sreeram M.V.
BuildMachineLabs
Underground mines present extreme conditions for autonomous robot navigation: GPS is denied, lighting is degraded, and tunnel topology is loop-rich and non-convex. Simulation benchmarks grounded in real production-mine geometry and compatible with GPU-accelerated learning pipelines do not yet exist in the open-source ecosystem. We present MineXplore, an open-source MuJoCo-based navigation benchmark derived from the Leung et al. 2017 Chilean underground copper mine dataset. The environment reconstructs a 104,423 sq.m tunnel network through an six-stage contour-to-MJCF pipeline incorporating octagonal wall cross-sections, LiDAR-sourced jagged wall geometry, three terrain friction zones, a global 5 degree incline, and periodic spot lighting. Geometric fidelity is validated at an Intersection over Union (IoU) of 0.9538 against the source survey map, and surface texture similarity scores 79.4% across six structural dimensions. A single-agent PPO baseline trained via RLlib across five independent random seeds achieves a best rolling coverage of 88.89% (3 of 5 seeds reaching the 90% coverage target), confirming that MineXplore supports stable and reproducible policy learning under realistic underground sensing and topology.
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: I'm Rosa.
Dev: And I'm Dev, here with Taro.
Rosa: We're looking at the paper: "MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment".
Dev: Here's the gist of the paper. Underground mines present extreme conditions for autonomous robot navigation: GPS is denied, lighting is degraded, and tunnel topology is loop-rich and non-convex MineXplore presents an open-source MuJoCo-based navigation benchmark derived from the Leung et al.
Rosa: 2017 Chilean underground copper mine dataset This environment reconstructs a 104,423 m2 tunnel network through an six-stage contour-to-MJCF pipeline incorporating octagonal wall cross-sections, LiDAR-sourced jagged wall geometry, three terrain friction zones, a global 5◦ incline, and periodic spot lighting A single-agent PPO baseline trained via RLlib across five independent random seeds achieves a best rolling coverage of 88.89% ± 1.74% (3 of 5 seeds reaching the 90% coverage target), confirming that MineXplore supports stable and reproducible policy learning under realistic underground sensing and topology Environment Construction MineXplore's geometry is derived from a real operational mine The compilation pipeline involves six stages, starting with source inputs like the published 2D survey floor-plan and LiDAR point cloud logs Stage 1 involves Source Data and Scale Calibration, where pixel-to-metric scale is calibrated against a 100 m scale bar yielding 1.36 px/m Stage 2 focuses on 2D Geometry Extraction using OpenCV contour detection to define the tunnel footprint and rock islands Stage 3 handles 3D Compilation, which includes polygon triangulation, extrusion to a nominal height of 3.5 m, and V-HACD convex decomposition into 1,186 collision geoms Stage 4 models Surface Wall Geometry by using a two-layer system comprising an 8-sided polygonal base layer and a LiDAR-sourced jagged overlay Realism Features Implementation The environment incorporates several features to replicate the physical conditions of the Chilean copper mine These realism features include: 1.
Dev: Terrain incline, where the entire MJCF worldbody is rotated 5◦ around the Y-axis, producing an effective elevation gain of 5.2 m across the entrance region 2.
Rosa: Terrain friction zones, which are implemented through three spatially fixed floor box geoms replicating dry (1.00), muddy (0.55), and waterlogged (0.25) zones 3.
Paper summary: Rosa: So we’re wrapping up our look at "MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment". This paper shows how they took a real Chilean copper mine dataset and compiled it into a MuJoCo environment that's ready for reinforcement learning one <ref:2606.04569#pg1>.
Dev: They spent their time detailing the six stages of this compilation pipeline, from initial 2D survey inputs to the final validated MJCF model, which is key because it shows how to ground simulation in real-world data three <ref:2606.04569#pg2>.
Taro: What’s significant about the conclusion is that they validate this geometric fidelity at an intersection over union of zero point nine five three eight against the source survey map three <ref:2606.04569#pg2>.
Rosa: They also report surface texture similarity scores of seventy nine point four percent across six structural dimensions, which gives us a sense of how accurate their reconstruction is compared to the original survey one <ref:2606.04569#pg1>.
Dev: The overall finding is that this environment supports stable and reproducible policy learning under realistic underground sensing and topology, even though the agent achieved a mean final coverage of eighty-four point five three percent across five independent seeds one <ref:2606.04569#pg1>.
Taro: The implication for autonomy is that having a simulation grounded in real production-mine geometry closes a gap for testing agents in these extreme underground environments, which is what this benchmark aims to do one <ref:2606.04569#pg1,grounded in real production-mine geometry>.
Rosa: So, the title "MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground Environment" points to this being the first environment compiled from a real operational mine inside MuJoCo/MJX one <ref:2606.04569#pg1,MineXplore: An Open-Source Reinforcement Learning Exploration Benchmark for GNSS-Denied Underground>.
Dev: It’s positioning it as a resource for open-source reinforcement learning exploration in environments where GPS is denied, lighting is degraded, and the tunnel topology is loop-rich and non-convex one <ref:2606.04569#pg1,tunnel topology is loop-rich and non-convex>.
Taro: The limitation they mention is that this work focuses on local observations and how the environment supports stable exploration learning under those conditions one <ref:2606.04569#pg1>.
Conclusion: Rosa: So, we're wrapping up our look at MineXplore, which is basically an open-source benchmark for testing how robots navigate underground mines without any GPS signal or good lighting one.
Dev: Yeah, it’s about taking a real Chilean copper mine and turning it into a MuJoCo environment that lets us study reinforcement learning in these tough conditions one.
Rosa: The authors are using this whole six-stage pipeline to build the model, starting from simple 2D floor plans and LiDAR data three <ref:2606.04569#pg2>.
Dev: They focus on making sure the geometry is solid, which they say means a very high intersection over union score of zero point nine five three eight against the original survey map three.
Rosa: That’s a lot of detail going into making sure the simulation actually looks like a real mine tunnel, including those jagged wall surfaces and different floor friction zones one.
Dev: The performance results show that their single-agent policy baseline got an aggregate best rolling coverage of eighty-eight point eight nine percent across five different random seeds one.
Rosa: So, what does this mean for the world? It means we finally have a simulation environment that’s built from actual operational mine data, closing the gap between lab testing and real-world underground autonomy one.
Dev: It supports stable policy learning under these realistic sensing and topology conditions, which is a big step for how we train robots for those kinds of jobs one.
Rosa: The authors point out that this work shows how local observations can lead to stable exploration learning in these challenging spaces one.
Dev: Their next steps involve using the full three dimensional LiDAR logs to make the geometry even better, and adding procedural changes to make the environment more diverse one.
Rosa: It’s an important foundation for future work on autonomous exploration in environments where you don't have perfect information, which brings us to how agents handle things when they misbehave next.
More episodes
- 2608.13438-ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
- 2610.34593-Future Prediction as Training-Only Video Supervision for Pretrained VLA Policies
- 2610.35385-EmbodiedLab: Beyond Manipulation, Benchmarking Embodied Agents That Act to Know
- 2610.36378-Data-Driven Hamiltonian for Neural Optimal Control
- 2610.37275-A Heuristic for Scheduling Autonomous Vehicles at Intersections
- 2610.37288-Dynamic Coordination of Autonomous Vehicles at Intersections
- 2610.37632-Real-Time Coordination of Autonomous Vehicles at Intersections
- 2611.13779-Softness is something you also need! Why compliance helps control: information metrics of a passive walker with compliant ankle
- 2611.13411-Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees
- 2611.14488-Is Your Robot's Memory Just a Clock? Temporal Shortcuts in Memory-Augmented VLA Policies