[PDF][PDF] Parameter synthesis in Markov models

S Junges - 2020 - publications.rwth-aachen.de
Markov models comprise states with probabilistic transitions. The analysis of these models is
ubiquitous and studied in, among others, reliability engineering, artificial intelligence …

Inductive synthesis for probabilistic programs reaches new horizons

R Andriushchenko, M Češka, S Junges… - … Conference on Tools …, 2021 - Springer
This paper presents a novel method for the automated synthesis of probabilistic programs.
The starting point is a program sketch representing a finite family of finite-state Markov …

Counterexample-driven synthesis for probabilistic program sketches

M Češka, C Hensel, S Junges, JP Katoen - International symposium on …, 2019 - Springer
Probabilistic programs are key to deal with uncertainty in, eg, controller synthesis. They are
typically small but intricate. Their development is complex and error prone requiring …

Certificates and witnesses for multi-objective queries in markov decision processes

C Baier, C Chau, S Klüppelholz - … of Systems and Formal Modeling and …, 2024 - Springer
Certifying verification algorithms not only return whether a given property holds or not, but
also provide an accompanying independently checkable certificate and a corresponding …

Counterexample-guided inductive synthesis for probabilistic systems

M Češka, C Hensel, S Junges, JP Katoen - Formal Aspects of Computing, 2021 - Springer
This paper presents counterexample-guided inductive synthesis (CEGIS) to automatically
synthesise probabilistic models. The starting point is a family of finite-stateMarkov chains …

An Oracle-Guided Approach to Constrained Policy Synthesis Under Uncertainty

R Andriushchenko, M Češka, F Macák, S Junges… - Journal of Artificial …, 2025 - jair.org
Dealing with aleatoric uncertainty is key in many domains involving sequential decision
making, eg, planning in AI, network protocols, and symbolic program synthesis. This paper …

Synthesis of discounted-reward optimal policies for Markov decision processes under linear temporal logic specifications

KC Kalagarla, R Jain, P Nuzzo - arxiv preprint arxiv:2011.00632, 2020 - arxiv.org
We present a method to find an optimal policy with respect to a reward function for a
discounted Markov decision process under general linear temporal logic (LTL) …

[PDF][PDF] Certificates and witnesses for probabilistic model checking

S Jantsch - 2022 - core.ac.uk
The ability to provide succinct information about why a property does, or does not, hold in a
given system is a key feature in the context of formal verification and model checking. It can …

Optimal control of discounted-reward Markov decision processes under linear temporal logic specifications

KC Kalagarla, R Jain, P Nuzzo - 2021 American Control …, 2021 - ieeexplore.ieee.org
We present a method to find an optimal policy with respect to a reward function for a
discounted Markov decision process under general linear temporal logic (LTL) …

(de-) Composed And More: Eager and Lazy Specifications (CAMELS) for Stochastic Hybrid Systems

L Willemsen, A Remke, E Ábrahám - … Dedicated to Joost-Pieter Katoen on …, 2024 - Springer
Different stochastic extensions of hybrid automata have been proposed in the past, with
unclear expressivity relations between them. In previous work, we related these modelling …