[HTML][HTML] A comprehensive survey of robust deep learning in computer vision

J Liu, Y ** - Journal of Automation and Intelligence, 2023 - Elsevier
Deep learning has presented remarkable progress in various tasks. Despite the excellent
performance, deep learning models remain not robust, especially to well-designed …

Probabilistic model checking and autonomy

M Kwiatkowska, G Norman… - Annual review of control …, 2022 - annualreviews.org
The design and control of autonomous systems that operate in uncertain or adversarial
environments can be facilitated by formal modeling and analysis. Probabilistic model …

Safe reinforcement learning using probabilistic shields

N Jansen, B Könighofer, S Junges… - 31st International …, 2020 - drops.dagstuhl.de
This paper concerns the efficient construction of a safety shield for reinforcement learning.
We specifically target scenarios that incorporate uncertainty and use Markov decision …

Safe reinforcement learning via shielding under partial observability

S Carr, N Jansen, S Junges, U Topcu - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Safe exploration is a common problem in reinforcement learning (RL) that aims to prevent
agents from making disastrous decisions while exploring their environment. A family of …

Safe policy improvement for POMDPs via finite-state controllers

TD Simão, M Suilen, N Jansen - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
We study safe policy improvement (SPI) for partially observable Markov decision processes
(POMDPs). SPI is an offline reinforcement learning (RL) problem that assumes access to (1) …

Decision-making under uncertainty: beyond probabilities: Challenges and perspectives

T Badings, TD Simão, M Suilen, N Jansen - International Journal on …, 2023 - Springer
This position paper reflects on the state-of-the-art in decision-making under uncertainty. A
classical assumption is that probabilities can sufficiently capture all uncertainty in a system …

Unifying qualitative and quantitative safety verification of DNN-controlled systems

D Zhi, P Wang, S Liu, CHL Ong, M Zhang - International Conference on …, 2024 - Springer
The rapid advance of deep reinforcement learning techniques enables the oversight of
safety-critical systems through the utilization of Deep Neural Networks (DNNs). This …

Search and explore: symbiotic policy synthesis in POMDPs

R Andriushchenko, A Bork, M Češka, S Junges… - … on Computer Aided …, 2023 - Springer
This paper marries two state-of-the-art controller synthesis methods for partially observable
Markov decision processes (POMDPs), a prominent model in sequential decision making …

Probabilistic guarantees for safe deep reinforcement learning

E Bacci, D Parker - Formal Modeling and Analysis of Timed Systems: 18th …, 2020 - Springer
Deep reinforcement learning has been successfully applied to many control tasks, but the
application of such controllers in safety-critical scenarios has been limited due to safety …

Under-approximating expected total rewards in POMDPs

A Bork, JP Katoen, T Quatmann - … Conference on Tools and Algorithms for …, 2022 - Springer
We consider the problem: is the optimal expected total reward to reach a goal state in a
partially observable Markov decision process (POMDP) below a given threshold? We tackle …