[책][B] Markov chains: Basic definitions

R Douc, E Moulines, P Priouret, P Soulier, R Douc… - 2018 - Springer
Heuristically, a discrete-time stochastic process has the Markov property if the past and
future are independent given the present. In this introductory chapter, we give the formal …