Parameter synthesis in markov models: A gentle survey
This paper surveys the analysis of parametric Markov models whose transitions are labelled
with functions over a finite set of parameters. These models are symbolic representations of …
with functions over a finite set of parameters. These models are symbolic representations of …
Parameter Synthesis for Markov Models: Covering the Parameter Space
Markov chain analysis is a key technique in formal verification. A practical obstacle is that all
probabilities in Markov models need to be known. However, system quantities such as …
probabilities in Markov models need to be known. However, system quantities such as …
Convex optimization for parameter synthesis in MDPs
Probabilistic model-checking aims to prove whether a Markov decision process (MDP)
satisfies a temporal logic specification. The underlying methods rely on an often unrealistic …
satisfies a temporal logic specification. The underlying methods rely on an often unrealistic …
Tools at the frontiers of quantitative verification: QComp 2023 competition report
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …
Inductive synthesis for probabilistic programs reaches new horizons
This paper presents a novel method for the automated synthesis of probabilistic programs.
The starting point is a program sketch representing a finite family of finite-state Markov …
The starting point is a program sketch representing a finite family of finite-state Markov …
The complexity of reachability in parametric Markov decision processes
This article presents the complexity of reachability decision problems for parametric Markov
decision processes (pMDPs), an extension to Markov decision processes (MDPs) where …
decision processes (pMDPs), an extension to Markov decision processes (MDPs) where …
Model checking finite-horizon Markov chains with probabilistic inference
We revisit the symbolic verification of Markov chains with respect to finite horizon
reachability properties. The prevalent approach iteratively computes step-bounded state …
reachability properties. The prevalent approach iteratively computes step-bounded state …
Fine-tuning the odds in Bayesian networks
This paper proposes new analysis techniques for Bayes networks in which conditional
probability tables (CPTs) may contain symbolic variables. The key idea is to exploit scalable …
probability tables (CPTs) may contain symbolic variables. The key idea is to exploit scalable …
Gradient-descent for randomized controllers under partial observability
Randomization is a powerful technique to create robust controllers, in particular in partially
observable settings. The degrees of randomization have a significant impact on the system …
observable settings. The degrees of randomization have a significant impact on the system …
Scenario-based verification of uncertain parametric MDPs
We consider parametric Markov decision processes (pMDPs) that are augmented with
unknown probability distributions over parameter values. The problem is to compute the …
unknown probability distributions over parameter values. The problem is to compute the …