Probe Sets for Nonlinear Kalman Filtering: Multi-Center Gains and Covariance Recalibration

arXiv:2609.14271 · eess.SY, cs.SY, eess.SP · Submitted 2026-09-13 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Robotics Radio. Generated commentary on the latest robotics and control papers.

Rosa: I'm Rosa, and with me are Dev and Taro, guest researcher.

Dev: Today's paper: "Probe Sets for Nonlinear Kalman Filtering".

Rosa: The gist The introduction presents probe sets to improve gain selection and covariance recalibration in nonlinear Kalman filters,

Dev: First, who's behind it and why it matters.

Paper summary: Rosa: So, to recap where we are, this paper tackles the problem of gain selection in nonlinear Kalman filters when the underlying distribution isn't simple enough for a single center approximation. The thesis is that conventional KFs get inaccurate gains and overconfident covariance estimates when one local model doesn't match the measurement geometry across all uncertainty.

Dev: They introduce probe sets, which are small collections of states scaled by the filter's covariance, where the filter can evaluate its usual moment rule repeatedly. The gain selection is then made by picking the gain that minimizes the average covariance reported across these local models.

Taro: They apply this construction across different KF variants without needing a specific approximation rule, which is important because it means you don't have to tailor this method for every single filter type you use.

Rosa: They also mention that they use this same probing construction in their previous covariance recalibration step to make the covariance reports more consistent after an update, which is just one more way they are improving uncertainty handling.

Dev: For quadratic measurements, they derived specific conditions under which probing gives lower normalized true error variance compared to the gain you'd get from that single center when prediction uncertainty is understated.

Taro: They prove this by showing that the minimizing gain in their framework is Kpm, which they define as C S minus one, where C and S are averages taken over all those probe members.

Rosa: And they establish covariance guarantees without needing the local moment approximation to be perfect; for quadratic measurements under an exact Gaussian prediction, probing provides a conservative covariance report that cannot increase the true error covariance under stated assumptions.

Dev: They also look at how this relates to their conventional center pair and gain, theta zero which is defined by C zero and S zero and the conventional gain K zero is just C zero S to the negative one <ref:2609.14271#pg1>.

Taro: The next identity they use isolates that covariance penalty caused by an inaccurate gain and expresses it in terms of moment error, showing how different gains behave differently when you're using a poor approximation.

Rosa: And finally, they compare each local moment map against its own probed version, and if the uncertainty is high enough, their true error covariances satisfy a condition that suggests probing gives a better report than the standard one.

Conclusion: Dev: So what does this mean when we look at the title, "Probe Sets for Nonlinear Kalman Filtering: Multi-Center Gains and Covariance Recalibration"? It’s about using multiple points to guide the gain selection instead of just one prediction.

Rosa: Exactly. The authors are showing that when you're dealing with nonlinear systems where uncertainty changes shape, relying on a single local approximation for those covariances is risky because it can lead to bad gains and overly confident covariance reports.

Taro: By using probe sets, they create a way to select the gain that minimizes the average reported covariance across those local models, which seems much more robust than just picking one center point.

Dev: The results show that this method keeps typical accuracy high while significantly reducing covariance inconsistency and those rare large-error trajectories in their simulations.

Rosa: It's about making the system more reliable in practice, especially when you don't have a very precise idea of how much uncertainty is actually there. The paper suggests that probe sets are a useful tool for improving both gain selection and covariance recalibration in these kinds of filters.

Taro: For someone just listening to the show, it means that if you're running an estimation system in the real world, this method could help keep your estimates stable even when the system dynamics are complex.

Dev: The authors also noted a limitation—specifically, they showed that they need prediction uncertainty to be understated for probing to yield lower normalized true error variance than the single-center gain.

Rosa: So, you can't just use this method if you're extremely unsure about your initial state; the performance benefit comes when the prediction uncertainty isn't too high. That sets a boundary on when this specific approach is most advantageous.

Department of Civil and Environmental Engineering, University of California, Berkeley · Department of Electrical Engineering, Chalmers University of Technology

eess.SY, cs.SY, eess.SP

Submitted: 2026-09-13

Updated: 2026-10-14

Code: https://github.com/Shida-Jiang/Probe_KF

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 71/100

The gist: The gist The introduction presents probe sets to improve gain selection and covariance recalibration in nonlinear Kalman filters, showing that probing preserves typical accuracy while substantially

Key concepts

Probe Sets
These are small collections of states scaled by covariance that the filter uses to repeat its local approximation. The filter evaluates its usual moment rule at each member and then selects a gain that minimizes the average reported covariance across these local models, accounting for variations in measurement geometry.
Covariance Recalibration
This step repeats the moment calculation at an updated state using the predicted covariance. In the probe framework, this results in a recalibration probe that retains the spread of uncertainty. A back-out rule is triggered when sums of variances before and after the update are compared.
Local Moment Map
A nonlinear Kalman filter cannot generally recover full state information from just the predicted mean and covariance. Instead, it applies a local moment map at each point. The paper uses these local maps to select a gain that minimizes the average reported error covariance across multiple probe members.

Summary

The gist The introduction presents probe sets to improve gain selection and covariance recalibration in nonlinear Kalman filters, showing that probing preserves typical accuracy while substantially reducing covariance inconsistency and rare large-error trajectories

Probe Set Framework

The paper introduces probe sets as small covariance-scaled collections of states at which the filter repeats its local approximation The filter evaluates its usual moment rule at each member, and then selects the gain that minimizes the average reported covariance across these local models This construction applies to different KF variants without requiring a specific approximation rule The proposed probe geometry is related to reduced sigma-point constructions, but the purposes are different, as each probe member serves as the center of a complete local moment approximation

Optimality and Bounds

Proposition 2 shows that the minimizing gain is Kpm:= C S−1, with C and S being averages over the probe members Proposition 3 establishes covariance guarantees without requiring the local moment approximation to be exact, showing that for quadratic measurements under an exact Gaussian prediction, probing provides a conservative covariance report and cannot increase the true error covariance under stated assumptions Specifically, the probe gain satisfies Prc((C, S); Kpm) = P − C tS−1 C⊤

Covariance Recalibration and Back-out

Covariance recalibration repeats the moment calculation at the updated state using the predicted covariance, and for the probe framework, this results in a recalibration probe that retains the spread P A back-out rule is triggered when JM(Prep) > JM(P), which compares sums of variances before and after the update The output state estimate and covariance are then determined based on this comparison, returning to the predicted values if the uncertainty increases

Experimental Validation

Simulations across two systems, four KF variants, and 300 randomized setups per system show that probing preserves typical accuracy while improving covariance consistency and reducing large-error tails The results show that probing preserves typical accuracy while substantially reducing covariance inconsistency and the rare large-error trajectories that dominate the root mean square of per-run errors F4 has the lowest geometric-mean RMS of per-run RMSE for every KF variant in both applications, while its median is within 5% of the best method in all eight combinations

Conclusion

Conventional nonlinear KFs approximate measurement moments at a single state, which can lead to inaccurate corrections and overconfident covariance estimates when the local model varies substantially across the uncertainty region Covariance-scaled probe sets account for this variation in gain selection and covariance recalibration The analysis shows why probing can be advantageous when prediction uncertainty is understated Future work will explore the use of probe sets in other state estimation methods, including moving horizon estimation

--- Page 3 ---

Kalman filters (KFs) select the gain as a function of two moments: the state–measurement cross-covariance and the innovation covariance For linear systems with correctly specified moments, both can be computed exactly, and the KF minimizes mean-square error among all linear estimators [1]

--- Page 4 ---

The central covariance of the candidate estimation error, averaged over the current state and measurement conditional on past measurements, is P t+(K) = P t − KCt⊤ − C tK⊤ + KStK⊤

--- Page 5 ---

A nonlinear KF cannot generally recover (C t, S t) from the predicted mean and covariance alone Instead, it applies a local moment map

--- Page 6 ---

The conventional center pair and gain are θ0:= ΘP (ˆx−) = (C0, S0), K0:= C0S−1 0 The next identity isolates the covariance penalty caused by an inaccurate gain and expresses it in terms of moment error [19]

--- Page 7 ---

The conventional covariance report is Pconv = Prc(θ0; K0) = P − C0S−1 C⊤ 0 Thus one local moment pair selects the correction and also determines the reported covariance at its estimated minimum

--- Page 8 ---

The update probe represents a collection of possible states around the predicted mean We select a gain that minimizes the average reported error covariance Prc(K):= 1/(n + 1) X i Prc((C i, S i); K) Proposition 2 shows that the minimizing gain is Kpm:= C S−1, with C and S being averages over the probe members

--- Page 9 ---

Proposition 3 bounds the true innovation covariance and the true error covariance of a fixed-gain correction by their probe-based reports for every moment map of the stated form At Kpm = C tS−1, the generalized Joseph report reduces to P − C tS−1 C⊤, which proves (31)

--- Page 10 ---

Proposition 4 compares each local moment map with its own probed version If υ ≥ 1 + δ, their true error covariances satisfy trP−1P t+(Kpm) ≤ trP−1P t+(K0)

--- Page 13 ---

Figure 4 and Table 2 show that probing substantially improves covariance consistency F4’s ANEES ranges from 0.98 to 1.

Improvements for AI systems

  1. Bold gain selection for nonlinear Kalman filters: The system can select a gain that minimizes the average reported covariance across these local models by evaluating probe sets, small covariance-scaled collections of states at which the filter repeats its local approximation.

  2. Covariance consistency improvement: The system will exhibit substantially reducing covariance inconsistency by implementing the probe framework, as it minimizes the average reported covariance and accounts for variations among local moment maps through the term slope-disagreement covariance (25).

  3. Improved performance under understated uncertainty: When prediction uncertainty is understated, the system can achieve a lower normalized true error variance than single-center updates by using the probe gain, as shown in Proposition 4, which states that probing improves the gain in normalized true error variance when prediction uncertainty is sufficiently understated.

  4. Enhanced large-error trajectory handling: The filter will reduce rare large-error trajectories that dominate the root mean square of per-run errors by using the probe framework, as simulations show F4 has a lower RMS of per-run RMSE compared to baselines across 300 randomized setups.

  5. Adaptive uncertainty management: The system implements a back-out rule triggered when "JM(Prep) > JM(P), allowing it to withdraw the update and return to the predicted mean and covariance" if the revised local approximation assigns greater uncertainty than the previous estimate, thereby preventing an increase in the true error covariance.

Related papers