Run-time optimization for learned controllers through quantitative games

G Avni, R Bloem, K Chatterjee, TA Henzinger… - … Aided Verification: 31st …, 2019 - Springer
A controller is a device that interacts with a plant. At each time point, it reads the plant's state
and issues commands with the goal that the plant operates optimally. Constructing optimal …

Rabinizer 4: from LTL to your favourite deterministic automaton

J Křetínský, T Meggendorfer, S Sickert… - … Conference on Computer …, 2018 - Springer
We present Rabinizer 4, a tool set for translating formulae of linear temporal logic to different
types of deterministic ω-automata. The tool set implements and optimizes several recent …

Value iteration for long-run average reward in Markov decision processes

P Ashok, K Chatterjee, P Daca, J Křetínský… - … on Computer Aided …, 2017 - Springer
Markov decision processes (MDPs) are standard models for probabilistic systems with non-
deterministic behaviours. Long-run average rewards provide a mathematically elegant …

Simple strategies in multi-objective MDPs

F Delgrange, JP Katoen, T Quatmann… - … Conference on Tools …, 2020 - Springer
We consider the verification of multiple expected reward objectives at once on Markov
decision processes (MDPs). This enables a trade-off analysis among multiple objectives by …

Adaptive shielding under uncertainty

S Pranger, B Könighofer, M Tappler… - 2021 American …, 2021 - ieeexplore.ieee.org
This paper targets control problems that exhibit specific safety and performance
requirements. In particular, the aim is to ensure that an agent, operating under uncertainty …

Stochastic games with lexicographic objectives

K Chatterjee, JP Katoen, S Mohr, M Weininger… - Formal Methods in …, 2024 - Springer
We study turn-based stochastic zero-sum games with lexicographic preferences over
objectives. Stochastic games are standard models in control, verification, and synthesis of …

Tools at the frontiers of quantitative verification: QComp 2023 competition report

R Andriushchenko, A Bork, CE Budde, M Češka… - International …, 2024 - Springer
The analysis of formal models that include quantitative aspects such as timing or
probabilistic choices is performed by quantitative verification tools. Broad and mature tool …

Risk-aware stochastic shortest path

T Meggendorfer - Proceedings of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
We treat the problem of risk-aware control for stochastic shortest path (SSP) on Markov
decision processes (MDP). Typically, expectation is considered for SSP, which however is …

Percentile queries in multi-dimensional Markov decision processes

M Randour, JF Raskin, O Sankur - Formal methods in system design, 2017 - Springer
Markov decision processes (MDPs) with multi-dimensional weights are useful to analyze
systems with multiple objectives that may be conflicting and require the analysis of trade …

Arena-independent finite-memory determinacy in stochastic games

P Bouyer, Y Oualhadj, M Randour… - Logical Methods in …, 2023 - lmcs.episciences.org
We study stochastic zero-sum games on graphs, which are prevalent tools to model decision-
making in presence of an antagonistic opponent in a random environment. In this setting, an …