On Skolem-hardness and saturation points in Markov decision processes

J Piribauer, C Baier - arxiv preprint arxiv:2004.11441, 2020 - arxiv.org
The Skolem problem and the related Positivity problem for linear recurrence sequences are
outstanding number-theoretic problems whose decidability has been open for many …

Multi-objective optimization of long-run average and total rewards

T Quatmann, JP Katoen - Tools and Algorithms for the Construction and …, 2021 - Springer
This paper presents an efficient procedure for multi-objective model checking of long-run
average reward (aka: mean pay-off) and total reward objectives as well as their combination …

Quantitative analysis of configurable and reconfigurable systems

C Dubslaff - 2022 - tud.qucosa.de
Abstract (EN) The often huge configuration spaces of modern software systems render the
detection, prediction, and explanation of defects and inadvertent behaviors challenging …

Verification of multi-objective Markov models

T Quatmann - 2023 - openreview.net
Probabilistische Systeme werden von Umgebungsereignissen beeinflusst, welche mit einer
gewissen Wahrscheinlichkeit auftreten. Damit solche Systeme einwandfrei funktionieren …

[PDF][PDF] On probability-raising causality in Markov decision processes.

C Baier, F Funke, J Piribauer, R Ziemek - FoSSaCS, 2022 - library.oapen.org
The purpose of this paper is to introduce a notion of causality in Markov decision processes
based on the probability-raising principle and to analyze its algorithmic properties. The latter …

Markov automata with multiple objectives

T Quatmann, S Junges, JP Katoen - Formal Methods in System Design, 2022 - Springer
Markov automata combine probabilistic branching, exponentially distributed delays and
nondeterminism. This compositional variant of continuous-time Markov decision processes …

The variance-penalized stochastic shortest path problem

J Piribauer, O Sankur, C Baier - arxiv preprint arxiv:2204.12280, 2022 - arxiv.org
The stochastic shortest path problem (SSPP) asks to resolve the non-deterministic choices
in a Markov decision process (MDP) such that the expected accumulated weight before …

Multi-weighted Markov decision processes with reachability objectives

P Bouyer, M González, N Markey… - arxiv preprint arxiv …, 2018 - arxiv.org
In this paper, we are interested in the synthesis of schedulers in double-weighted Markov
decision processes, which satisfy both a percentile constraint over a weighted reachability …

Playing against fair adversaries in stochastic games with total rewards

PF Castro, PR D'Argenio, R Demasi… - … Conference on Computer …, 2022 - Springer
We investigate zero-sum turn-based two-player stochastic games in which the objective of
one player is to maximize the amount of rewards obtained during a play, while the other …

On non-classical stochastic shortest path problems

J Piribauer - 2021 - tud.qucosa.de
Abstract (EN) The stochastic shortest path problem lies at the heart of many questions in the
formal verification of probabilistic systems. It asks to find a scheduler resolving the non …