New arXiv note: Continuity of imprecise Markov chains with respect to the pointwise convergence of monotone sequences of gambles
Continuity of imprecise Markov chains with respect to the pointwise convergence of monotone sequences of gambles (arXiv page)
by Jasper De Bock and Gert de Cooman
Abstract: The aim of these notes is to study the conditions under which the natural extension of an imprecise Markov chain is continuous with respect to the pointwise convergence of monotone (either non-decreasing or non-increasing) sequences of gambles that are n-measurable, with n a natural number. The framework in which we do this is that of the theory of imprecise random processes currently being developed in (De Cooman, 2014). We find that for non-decreasing sequences, continuity is always guaranteed if the state space of the Markov chain is finite. We find a similar result for non-increasing sequences, under the extra condition that the joint model is constructed using the Ville-Vovk-Shafer natural extension rather than the Williams natural extension. We also discuss the extent to which these results apply to general random processes.
This is a note containing the proofs of two useful continuity results for monotone adapted processes in imprecise Markov chains. We intend to include them, or rely on them, in forthcoming papers on Markov processes, and on stochastic processes using imprecise probabilities. I will post more bibliographic details on my UGent website as they come in.