The probabilistic model checker Storm
We present the probabilistic model checker Storm. Storm supports the analysis of discrete-
and continuous-time variants of both Markov chains and Markov decision processes. Storm …
and continuous-time variants of both Markov chains and Markov decision processes. Storm …
On correctness, precision, and performance in quantitative verification: QComp 2020 competition report
Quantitative verification tools compute probabilities, expected rewards, or steady-state
values for formal models of stochastic and timed systems. Exact results often cannot be …
values for formal models of stochastic and timed systems. Exact results often cannot be …
The 2019 Comparison of Tools for the Analysis of Quantitative Formal Models: (QComp 2019 Competition Report)
Quantitative formal models capture probabilistic behaviour, real-time aspects, or general
continuous dynamics. A number of tools support their automatic analysis with respect to …
continuous dynamics. A number of tools support their automatic analysis with respect to …
Simple strategies in multi-objective MDPs
We consider the verification of multiple expected reward objectives at once on Markov
decision processes (MDPs). This enables a trade-off analysis among multiple objectives by …
decision processes (MDPs). This enables a trade-off analysis among multiple objectives by …
Multi-cost bounded tradeoff analysis in MDP
We provide a memory-efficient algorithm for multi-objective model checking problems on
Markov decision processes (MDPs) with multiple cost structures. The key problem at hand is …
Markov decision processes (MDPs) with multiple cost structures. The key problem at hand is …
Stochastic games with lexicographic reachability-safety objectives
We study turn-based stochastic zero-sum games with lexicographic preferences over
reachability and safety objectives. Stochastic games are standard models in control …
reachability and safety objectives. Stochastic games are standard models in control …
Evolutionary-guided synthesis of verified pareto-optimal MDP policies
We present a new approach for synthesising Paretooptimal Markov decision process (MDP)
policies that satisfy complex combinations of quality-of-service (QoS) software requirements …
policies that satisfy complex combinations of quality-of-service (QoS) software requirements …
Multi-objective optimization of long-run average and total rewards
This paper presents an efficient procedure for multi-objective model checking of long-run
average reward (aka: mean pay-off) and total reward objectives as well as their combination …
average reward (aka: mean pay-off) and total reward objectives as well as their combination …
[PDF][PDF] Life is random, time is not: Markov decision processes with window objectives
The window mechanism was introduced by Chatterjee et al. to strengthen classical game
objectives with time bounds. It permits to synthesize system controllers that exhibit …
objectives with time bounds. It permits to synthesize system controllers that exhibit …
Synthesis of discounted-reward optimal policies for Markov decision processes under linear temporal logic specifications
We present a method to find an optimal policy with respect to a reward function for a
discounted Markov decision process under general linear temporal logic (LTL) …
discounted Markov decision process under general linear temporal logic (LTL) …