A review of safe reinforcement learning: Methods, theories and applications

S Gu, L Yang, Y Du, G Chen, F Walter… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Reinforcement Learning (RL) has achieved tremendous success in many complex decision-
making tasks. However, safety concerns are raised during deploying RL in real-world …

Exact verification of relu neural control barrier functions

H Zhang, J Wu, Y Vorobeychik… - Advances in neural …, 2023 - proceedings.neurips.cc
Abstract Control Barrier Functions (CBFs) are a popular approach for safe control of
nonlinear systems. In CBF-based control, the desired safety properties of the system are …

Compositional policy learning in stochastic control systems with formal guarantees

Đ Žikelić, M Lechner, A Verma… - Advances in …, 2024 - proceedings.neurips.cc
Reinforcement learning has shown promising results in learning neural network policies for
complicated control tasks. However, the lack of formal guarantees about the behavior of …

Learning control policies for stochastic systems with reach-avoid guarantees

Đ Žikelić, M Lechner, TA Henzinger… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
We study the problem of learning controllers for discrete-time non-linear stochastic
dynamical systems with formal reach-avoid guarantees. This work presents the first method …

Unifying qualitative and quantitative safety verification of DNN-controlled systems

D Zhi, P Wang, S Liu, CHL Ong, M Zhang - International Conference on …, 2024 - Springer
The rapid advance of deep reinforcement learning techniques enables the oversight of
safety-critical systems through the utilization of Deep Neural Networks (DNNs). This …

Verification of neural control barrier functions with symbolic derivative bounds propagation

H Hu, Y Yang, T Wei, C Liu - arxiv preprint arxiv:2410.16281, 2024 - arxiv.org
Control barrier functions (CBFs) are important in safety-critical systems and robot control
applications. Neural networks have been used to parameterize and synthesize CBFs with …

Data-driven invariant set for nonlinear systems with application to command governors

A Kashani, C Danielson - Automatica, 2025 - Elsevier
This paper presents a novel approach to synthesize positive invariant sets for unmodeled
nonlinear systems using direct data-driven techniques. The data-driven invariant sets are …

Formal abstraction of general stochastic systems via noise partitioning

J Skovbekk, L Laurenti, E Frew… - IEEE Control Systems …, 2023 - ieeexplore.ieee.org
Verifying the performance of safety-critical, stochastic systems with complex noise
distributions is difficult. We introduce a general procedure for the finite abstraction of …

Fossil 2.0: Formal Certificate Synthesis for the Verification and Control of Dynamical Models

A Edwards, A Peruffo, A Abate - Proceedings of the 27th ACM …, 2024 - dl.acm.org
This paper presents Fossil 2.0, a new major release of a software tool for the synthesis of
certificates (eg, Lyapunov and barrier functions) for dynamical systems modelled as ordinary …

Simultaneous synthesis and verification of neural control barrier functions through branch-and-bound verification-in-the-loop training

X Wang, L Knoedler, FB Mathiesen… - 2024 European …, 2024 - ieeexplore.ieee.org
Control Barrier Functions (CBFs) that provide formal safety guarantees have been widely
used for safety-critical systems. However, it is non-trivial to design a CBF. Utilizing neural …