Parameter Synthesis for Markov Models: Covering the Parameter Space

S Junges, E Ábrahám, C Hensel, N Jansen… - arxiv preprint arxiv …, 2019 - arxiv.org
Markov chain analysis is a key technique in formal verification. A practical obstacle is that all
probabilities in Markov models need to be known. However, system quantities such as …

Extracting individual characteristics from population data reveals a negative social effect during honeybee defence

T Petrov, M Hajnal, J Klein, D Šafránek… - PLoS Computational …, 2022 - journals.plos.org
Honeybees protect their colony against vertebrates by mass stinging and they coordinate
their actions during this crucial event thanks to an alarm pheromone carried directly on the …

Scenario-based verification of uncertain parametric MDPs

T Badings, M Cubuktepe, N Jansen, S Junges… - International Journal on …, 2022 - Springer
We consider parametric Markov decision processes (pMDPs) that are augmented with
unknown probability distributions over parameter values. The problem is to compute the …

[PDF][PDF] Safe policy search using Gaussian process models

K Polymenakos, A Abate… - Proceedings of the 18th …, 2019 - oxford-man.ox.ac.uk
We propose a method to optimise the parameters of a policy which will be used to safely
perform a given task in a data-efficient manner. We train a Gaussian process model to …

Parameter synthesis for Markov models: covering the parameter space

S Junges, E Ábrahám, C Hensel, N Jansen… - Formal Methods in …, 2024 - Springer
Markov chain analysis is a key technique in formal verification. A practical obstacle is that all
probabilities in Markov models need to be known. However, system quantities such as …

Jajapy: a learning library for stochastic models

R Reynouard, A Ingólfsdóttir, G Bacci - International Conference on …, 2023 - Springer
Abstract We present Jajapy, a Python library that implements a number of methods to aid the
modelling process of Markov models from a set of partially-observable executions of the …

Probabilistic approximation of runtime quantitative verification in self-adaptive systems

MA Nia, M Kargahi, F Faghih - Microprocessors and microsystems, 2020 - Elsevier
Cyber-physical systems (CPS) are expected to continuously monitor the physical
components to autonomously calculate appropriate runtime reactions to deal with the …

Automated experiment design for data-efficient verification of parametric Markov decision processes

E Polgreen, VB Wijesuriya, S Haesaert… - Quantitative Evaluation of …, 2017 - Springer
We present a new method for statistical verification of quantitative properties over a partially
unknown system with actions, utilising a parameterised model (in this work, a parametric …

Combining formal methods and Bayesian approach for inferring discrete-state stochastic models from steady-state data

J Klein, H Phung, M Hajnal, D Šafránek, T Petrov - Plos one, 2023 - journals.plos.org
Stochastic population models are widely used to model phenomena in different areas such
as cyber-physical systems, chemical kinetics, collective animal behaviour, and beyond …

ABC (SMC): Simultaneous Inference and Model Checking of Chemical Reaction Networks

GW Molyneux, A Abate - … on Computational Methods in Systems Biology, 2020 - Springer
We present an approach that simultaneously infers model parameters while statistically
verifying properties of interest to chemical reaction networks, which we observe through data …