Lower and Upper Expected Hitting Times for Weighted Imprecise Markov Chains

arXiv:2603.16665 · math.PR · Submitted 2026-03-17 · Read on arXiv

math.PR

Submitted: 2026-03-17

Updated: 2026-10-30

Comments: Published for International Conference on Soft Methods in Probability and Statistics (SMPS)

License: http://creativecommons.org/licenses/by/4.0/

The gist: In this paper, we extend hitting times for imprecise Markov chains to the framework of weighted imprecise Markov chains (WIMCs)…

Terminology

Abstract

In this paper, we extend hitting times for imprecise Markov chains to the framework of weighted imprecise Markov chains (WIMCs), in which each transition is associated with a strictly positive weight encoded by a matrix W. Given a convex set T of admissible transition matrices, we define lower and upper expected hitting times for WIMCs as the infimum and supremum of the (weighted) expected hitting times over T, and we characterise these quantities as the unique solutions of nonlinear fixed-point equations. We show that any weighted hitting time problem can be transformed into an unweighted hitting time problem on an augmented state space, enabling the reuse of existing IMC theory and algorithms. In particular, we are able to adapt known iterative methods for the numerical computation of lower and upper hitting times for WIMCs.

Sources

Related papers