Parameter synthesis in markov models: A gentle survey

N Jansen, S Junges, JP Katoen - … of Systems Design: Essays Dedicated to …, 2022 - Springer
This paper surveys the analysis of parametric Markov models whose transitions are labelled
with functions over a finite set of parameters. These models are symbolic representations of …

Parameter Synthesis for Markov Models: Covering the Parameter Space

S Junges, E Ábrahám, C Hensel, N Jansen… - arxiv preprint arxiv …, 2019 - arxiv.org
Markov chain analysis is a key technique in formal verification. A practical obstacle is that all
probabilities in Markov models need to be known. However, system quantities such as …

Convex optimization for parameter synthesis in MDPs

M Cubuktepe, N Jansen, S Junges… - … on Automatic Control, 2021 - ieeexplore.ieee.org
Probabilistic model-checking aims to prove whether a Markov decision process (MDP)
satisfies a temporal logic specification. The underlying methods rely on an often unrealistic …

Tools at the frontiers of quantitative verification: QComp 2023 competition report

R Andriushchenko, A Bork, CE Budde, M Češka… - International …, 2024 - Springer
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …

Inductive synthesis for probabilistic programs reaches new horizons

R Andriushchenko, M Češka, S Junges… - … Conference on Tools …, 2021 - Springer
This paper presents a novel method for the automated synthesis of probabilistic programs.
The starting point is a program sketch representing a finite family of finite-state Markov …

The complexity of reachability in parametric Markov decision processes

S Junges, JP Katoen, GA Pérez, T Winkler - Journal of Computer and …, 2021 - Elsevier
This article presents the complexity of reachability decision problems for parametric Markov
decision processes (pMDPs), an extension to Markov decision processes (MDPs) where …

Model checking finite-horizon Markov chains with probabilistic inference

S Holtzen, S Junges, M Vazquez-Chanlatte… - … on Computer Aided …, 2021 - Springer
We revisit the symbolic verification of Markov chains with respect to finite horizon
reachability properties. The prevalent approach iteratively computes step-bounded state …

Fine-tuning the odds in Bayesian networks

B Salmani, JP Katoen - … on Symbolic and Quantitative Approaches with …, 2021 - Springer
This paper proposes new analysis techniques for Bayes networks in which conditional
probability tables (CPTs) may contain symbolic variables. The key idea is to exploit scalable …

Gradient-descent for randomized controllers under partial observability

L Heck, J Spel, S Junges, J Moerman… - … Conference on Verification …, 2022 - Springer
Randomization is a powerful technique to create robust controllers, in particular in partially
observable settings. The degrees of randomization have a significant impact on the system …

Scenario-based verification of uncertain parametric MDPs

T Badings, M Cubuktepe, N Jansen, S Junges… - International Journal on …, 2022 - Springer
We consider parametric Markov decision processes (pMDPs) that are augmented with
unknown probability distributions over parameter values. The problem is to compute the …