Robust markov decision processes: A place where AI and formal methods meet

M Suilen, T Badings, EM Bovy, D Parker… - Principles of Verification …, 2024 - Springer
Markov decision processes (MDPs) are a standard model for sequential decision-making
problems and are widely used across many scientific areas, including formal methods and …

Accurately computing expected visiting times and stationary distributions in Markov chains

H Mertens, JP Katoen, T Quatmann… - … Conference on Tools and …, 2024 - Springer
We study the accurate and efficient computation of the expected number of times each state
is visited in discrete-and continuous-time Markov chains. To obtain sound accuracy …