Probabilistic model checking and autonomy

M Kwiatkowska, G Norman… - Annual review of control …, 2022 - annualreviews.org
The design and control of autonomous systems that operate in uncertain or adversarial
environments can be facilitated by formal modeling and analysis. Probabilistic model …

Automated verification and synthesis of stochastic hybrid systems: A survey

A Lavaei, S Soudjani, A Abate, M Zamani - Automatica, 2022 - Elsevier
Stochastic hybrid systems have received significant attentions as a relevant modeling
framework describing many systems, from engineering to the life sciences: they enable the …

Robust dynamic programming for temporal logic control of stochastic systems

S Haesaert, S Soudjani - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
Discrete-time stochastic systems are an essential modeling tool for many engineering
systems. We consider stochastic control systems that are evolving over continuous spaces …

Analyzing neural network behavior through deep statistical model checking

TP Gros, H Hermanns, J Hoffmann, M Klauck… - International Journal on …, 2023 - Springer
Neural networks (NN) are taking over ever more decisions thus far taken by humans, even
though verifiable system-level guarantees are far out of reach. Neither is the verification …

[PDF][PDF] Scaling learning based policy optimization for temporal tasks via dropout

N Hashemi, B Hoxha, D Prokhorov… - arxiv preprint arxiv …, 2024 - researchgate.net
This paper introduces a model-based approach for training feedback controllers for an
autonomous agent operating in a highly nonlinear (albeit deterministic) environment. We …

Compositional abstraction-based synthesis of general MDPs via approximate probabilistic relations

A Lavaei, S Soudjani, M Zamani - Nonlinear Analysis: Hybrid Systems, 2021 - Elsevier
We propose a compositional approach for constructing abstractions of general Markov
decision processes (gMDPs) using approximate probabilistic relations. The abstraction …

Automata-based controller synthesis for stochastic systems: A game framework via approximate probabilistic relations

B Zhong, A Lavaei, M Zamani, M Caccamo - Automatica, 2023 - Elsevier
In this work, we propose an abstraction and refinement methodology for the controller
synthesis of discrete-time stochastic systems to enforce complex logical properties …

Temporal logic control of pomdps via label-based stochastic simulation relations

S Haesaert, P Nilsson, CI Vasile, R Thakker… - IFAC-PapersOnLine, 2018 - Elsevier
The synthesis of controllers guaranteeing linear temporal logic specifications on partially
observable Markov decision processes (POMDP) via their belief models causes …

Arch-comp22 category report: stochastic models

A Abate, H Blom, J Delicaris, S Haesaert… - EPiC Series in …, 2022 - research.tue.nl
This report presents the results of a friendly competition for formal verification and policy
synthesis of stochastic models. It also introduces new benchmarks and their properties …

Formal multi-objective synthesis of continuous-state MDPs

S Haesaert, P Nilsson… - 2021 American Control …, 2021 - ieeexplore.ieee.org
This paper studies formal synthesis of control policies for continuous-state MDPs. In the
quest to satisfy complex combinations of probabilistic temporal logic specifications, we …