Pareto curves for compositionally model checking string diagrams of MDPs

K Watanabe, M van der Vegt, I Hasuo, J Rot… - … Conference on Tools …, 2024 - Springer
Computing schedulers that optimize reachability probabilities in MDPs is a standard
verification task. To address scalability concerns, we focus on MDPs that are compositionally …

Playing games with your PET: extending the partial exploration tool to stochastic games

T Meggendorfer, M Weininger - International Conference on Computer …, 2024 - Springer
We present version 2.0 of the Partial Exploration Tool (Pet), a tool for verification of
probabilistic systems. We extend the previous version by adding support for stochastic …

Search and explore: Symbiotic policy synthesis in pomdps

R Andriushchenko, A Bork, M Češka, S Junges… - … on Computer Aided …, 2023 - Springer
This paper marries two state-of-the-art controller synthesis methods for partially observable
Markov decision processes (POMDPs), a prominent model in sequential decision making …

Compositional value iteration with pareto caching

K Watanabe, M Vegt, S Junges, I Hasuo - International Conference on …, 2024 - Springer
The de-facto standard approach in MDP verification is based on value iteration (VI). We
propose compositional VI, a framework for model checking compositional MDPs, that …

Stop** criteria for value iteration on stochastic games with quantitative objectives

J Křetínský, T Meggendorfer… - 2023 38th Annual ACM …, 2023 - ieeexplore.ieee.org
A classic solution technique for Markov decision processes (MDP) and stochastic games
(SG) is value iteration (VI). Due to its good practical performance, this approximative …

Tools at the frontiers of quantitative verification: QComp 2023 competition report

R Andriushchenko, A Bork, CE Budde, M Češka… - International …, 2024 - Springer
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …

Fast verified SCCs for probabilistic model checking

A Hartmanns, B Kohlen, P Lammich - International Symposium on …, 2023 - Springer
High-performance probabilistic model checkers like the Modest Toolset's mcsta follow the
topological ordering of an MDP's strongly connected components (SCCs) to speed up the …

Towards verifying robotic systems using statistical model checking in STORM

M Lampacrescia, M Klauck, M Palmas - … on Bridging the Gap between AI …, 2024 - Springer
Robust autonomy and interaction of robots with their environment, even in rare or new
situations, is an ultimate goal of robotics research. We settle on Statistical Model Checking …

Robust markov decision processes: A place where AI and formal methods meet

M Suilen, T Badings, EM Bovy, D Parker… - Principles of Verification …, 2024 - Springer
Markov decision processes (MDPs) are a standard model for sequential decision-making
problems and are widely used across many scientific areas, including formal methods and …

Tools at the frontiers of quantitative verification

R Andriushchenko, A Bork, CE Budde, M Češka… - TOOLympics Challenge …, 2024 - Springer
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …