Probabilistic model checking and Markov decision processes (MDPs) form two interlinked branches of formal analysis for systems operating under uncertainty. These techniques offer a mathematical ...

Journal of the Royal Statistical Society. Series B (Statistical Methodology), Vol. 68, No. 2 (2006), pp. 155-178 (24 pages) For a class of latent Markov models for discrete variables having a ...

A 30-minute talk about Markov modeling generally, with specific reference to the seminal 1986 contribution of Professor Eaves, which described Markov processes for genetic and environmental variance ...

The paper proposes a statistical model of a football match that is useful in providing insights into the characteristics of teams. We evaluate the characteristics by means of maximum likelihood ...

This paper proposes a hidden state Markov model (HMM) that incorporates workers’ unobserved labor market attachment into the analysis of labor market dynamics. Unlike previous literature, which ...