MosaicIMU: Composing Carrier Experts for Generalizable Neural Inertial Odometry
summary
The gist
Robust inertial odometry is essential for various carriers when external sensing is unreliable Learningbased methods reduce integration drift by capturing local motion priors…
In short
MosaicIMU is a carrier-conditioned Mixture-of-Experts (MoE) framework for neural inertial odometry. It uses a prototype-based router to dynamically compose carrier-specific expert features and integrates local velocity constraints with a history-aware EKF. This approach significantly reduces integration drift, achieving 40% and 34% reductions in ATE and RTE10s compared to learning-based baselines, offering a scalable pretraining paradigm for generalizable odometry.
Key concepts
- Mixture-of-Experts (MoE)
- A framework where different specialized neural networks (experts) work together. MosaicIMU uses this by having a router select and combine features from carrier-specific experts based on the current motion, allowing the system to handle different vehicle types effectively.
- Prototype-based Router
- This is a mechanism that decides which expert features are most relevant for a given situation. It compares incoming inertial data against learned 'prototypes' representing different carrier characteristics to generate routing weights, enabling sample-adaptive feature composition.
- History-aware EKF
- An Extended Kalman Filter (EKF) enhanced to consider past poses and local velocity constraints. This allows the system to maintain a stable state estimate by comparing the current prediction with historical trajectory information, ensuring consistency without needing absolute global yaw observations.
Terminology used across episodes
This episode discusses
- MosaicIMU: Composing Carrier Experts for Generalizable Neural Inertial Odometry · Paper Radio
- KISS-IMU: Self-supervised Inertial Odometry with Motion-balanced Learning and Uncertainty-aware Inference
- i2Nav-Robot: A Large-Scale Indoor-Outdoor Robot Dataset for Multi-Sensor Fusion Navigation
The paper
MosaicIMU: Composing Carrier Experts for Generalizable Neural Inertial Odometry · Read on arXiv
Junye Zou, Huiyi Yan, Xinning Xu, Xiaolei Li, Pengkun Zhou, Jinhui Zhang, Ziyang Meng
Tsinghua University
Transcript
Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.
Rosa: I'm Rosa.
Dev: And I'm Dev, here with Taro.
Rosa: We're looking at the paper: "MosaicIMU: Composing Carrier Experts for Generalizable Neural Inertial Odometry".
Dev: Here's the gist of the paper. Robust inertial odometry is essential for various carriers when external sensing is unreliable Learningbased methods reduce integration drift by capturing local motion priors, but these methods often remain tied to a particular carrier, limiting generalization across heterogeneous platforms We present MosaicIMU, a carrier-conditioned Mixture-of-Experts (MoE) pretraining-and-adaptation framework for generalizable neural inertial odometry MosaicIMU uses a prototype-based router to compose carrier-specific expert features, decodes local velocity and uncertainty constraints, and integrates them with a history-aware EKF Experiments show that MosaicIMU consistently outperforms learning-based baselines, reducing average ATE and RTE10s by 40% and 34%, respectively These results highlight that MosaicIMU provides a scalable pretraining-to-deployment paradigm for generalizable and adaptive neural inertial odometry.
Rosa: Pruning redundant reasoning tokens MosaicIMU is a carrier-conditioned Mixture-of-Experts (MoE) framework designed to achieve sampleadaptive, feature-level expert composition and integrate local velocity constraints with a history-aware EKF for stable state estimation.
Dev: The framework utilizes a prototype-based router to compose carrier-specific expert features and then decodes local velocity and uncertainty constraints before integrating them into the history-aware EKF.
Rosa: For unseen domain adaptation, the method freezes the pretrained base model and learns a new lightweight expert residual branch for efficient adaptation.
Paper summary: Rosa: So, we're wrapping up our look at MosaicIMU today, titled "Composing Carrier Experts for Generalizable Neural Inertial Odometry." Basically, this paper is about how they built a system that can handle different types of sensors—different carriers—without needing a completely new training setup every time.
Dev: Right. It’s taking the idea of using many specialized experts and making them work together intelligently based on what kind of motion you see right now. They used this mixture-of-experts framework to get better results when generalizing across different platforms compared to just training one model for one specific car or robot.
Taro: What really stands out is how they handled adaptation online. They showed that even when the system encounters a completely new type of motion pattern, it can pick informative data points from the real world to update itself efficiently without having to start all over again from scratch.
Rosa: That’s what I liked about it. It moves us toward something that could be truly general purpose neural inertial odometry, not just something tuned perfectly for one specific vehicle or setting. The authors also found that by using a soft way of routing these experts, the system is much more flexible when dealing with different kinds of motion physics.
Dev: Flexibility is good for real-time control. It means the estimation loop doesn't break as easily when things get weird on the road or in a warehouse. They also found that they could achieve a forty percent drop in error metrics like ATE just by making these smart choices about which expert features to combine.
Taro: And those results on vehicle and pedestrian sequences, where the motion is naturally very different, really show that this method works well for heterogeneous motion patterns. It’s not just fine on one thing; it's good at handling the mix of things you see in the real world.
Rosa: Exactly. So, MosaicIMU provides a scalable way to get neural odometry that can adapt to new situations and different hardware better than what we have now. But we've got some caveats, right?
Dev: Yeah, the authors were upfront about it. They said the current performance is still tied to the amount of data they used and which specific carriers they tested on. Also, for real deployment, you still need reasonably stable sensor readings; if things get too chaotic or your mounting changes drastically, it might start failing.
Taro: So while the potential for generalization is there—being able to handle new motion types—we can't assume it will work flawlessly in every single crazy scenario without more robust data and better uncertainty handling.
Rosa: That’s the balance of it. It’s a solid foundation, but we still have some work to do before you can fully trust this as a general solution for every application. Next up, we're going to look at how they actually trained this whole thing—the math behind those expert losses and prototypes.
Conclusion: Rosa: So, to wrap up this discussion on MosaicIMU, we're talking about how they built this system called "Composing Carrier Experts for Generalizable Neural Inertial Odometry."
Dev: Right. This whole framework is essentially about taking those different carrier-specific motion models and stitching them together intelligently so you get one system that works better everywhere than a single model trained for just one type of vehicle.
Taro: What this implies is that we can build odometry that doesn't break when you switch from driving a car to walking down the street, because it learns how to mix those motion types.
Rosa: It's about making neural inertial odometry more robust and adaptable across different hardware and environments without needing a completely fresh training session for every new setup. The authors show they achieved this by using this mixture-of-experts structure that lets the system decide which expert features are most relevant for the current motion situation.
Dev: And they did get solid numbers showing that this approach reduces errors, like the average absolute trajectory error, by forty percent and relative trajectory error by thirty-four percent across four different carrier categories. That’s a big jump for real navigation systems.
Taro: But it's not magic either. They pointed out that the method still depends on how much data you train it on and what specific sensors you tested it with, so we can't assume it will handle every weird motion pattern imaginable without more training.
Rosa: Exactly. It’s a strong step toward generalizable odometry, but we still need to figure out how to make that router even smarter about uncertainty estimation when things get really unexpected out there.
Dev: And that’s what we'll be diving into next—we need to look at the actual math behind how they built these expert losses and prototypes so we can understand exactly how they achieved these results.
More episodes
- 2608.13438-ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
- 2610.34593-Future Prediction as Training-Only Video Supervision for Pretrained VLA Policies
- 2610.35385-EmbodiedLab: Beyond Manipulation, Benchmarking Embodied Agents That Act to Know
- 2610.36378-Data-Driven Hamiltonian for Neural Optimal Control
- 2610.37275-A Heuristic for Scheduling Autonomous Vehicles at Intersections
- 2610.37288-Dynamic Coordination of Autonomous Vehicles at Intersections
- 2610.37632-Real-Time Coordination of Autonomous Vehicles at Intersections
- 2611.13779-Softness is something you also need! Why compliance helps control: information metrics of a passive walker with compliant ankle
- 2611.13411-Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees
- 2611.14488-Is Your Robot's Memory Just a Clock? Temporal Shortcuts in Memory-Augmented VLA Policies