A review of safe reinforcement learning: Methods, theories and applications

S Gu, L Yang, Y Du, G Chen, F Walter… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Reinforcement Learning (RL) has achieved tremendous success in many complex decision-
making tasks. However, safety concerns are raised during deploying RL in real-world …

Exact verification of relu neural control barrier functions

H Zhang, J Wu, Y Vorobeychik… - Advances in neural …, 2023 - proceedings.neurips.cc
Abstract Control Barrier Functions (CBFs) are a popular approach for safe control of
nonlinear systems. In CBF-based control, the desired safety properties of the system are …

Lyapunov-stable neural control for state and output feedback: A novel formulation

L Yang, H Dai, Z Shi, CJ Hsieh, R Tedrake… - arxiv preprint arxiv …, 2024 - arxiv.org
Learning-based neural network (NN) control policies have shown impressive empirical
performance in a wide range of tasks in robotics and control. However, formal (Lyapunov) …

Fossil 2.0: Formal certificate synthesis for the verification and control of dynamical models

A Edwards, A Peruffo, A Abate - Proceedings of the 27th ACM …, 2024 - dl.acm.org
This paper presents Fossil 2.0, a new major release of a software tool for the synthesis of
certificates (eg, Lyapunov and barrier functions) for dynamical systems modelled as ordinary …

Learning control policies for stochastic systems with reach-avoid guarantees

Đ Žikelić, M Lechner, TA Henzinger… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
We study the problem of learning controllers for discrete-time non-linear stochastic
dynamical systems with formal reach-avoid guarantees. This work presents the first method …

Compositional policy learning in stochastic control systems with formal guarantees

Đ Žikelić, M Lechner, A Verma… - Advances in …, 2023 - proceedings.neurips.cc
Reinforcement learning has shown promising results in learning neural network policies for
complicated control tasks. However, the lack of formal guarantees about the behavior of …

Unifying qualitative and quantitative safety verification of DNN-controlled systems

D Zhi, P Wang, S Liu, CHL Ong, M Zhang - International Conference on …, 2024 - Springer
The rapid advance of deep reinforcement learning techniques enables the oversight of
safety-critical systems through the utilization of Deep Neural Networks (DNNs). This …

Verification of neural control barrier functions with symbolic derivative bounds propagation

H Hu, Y Yang, T Wei, C Liu - arxiv preprint arxiv:2410.16281, 2024 - arxiv.org
Control barrier functions (CBFs) are important in safety-critical systems and robot control
applications. Neural networks have been used to parameterize and synthesize CBFs with …

Formally verified neural network control barrier certificates for unknown systems

M Anand, M Zamani - IFAC-PapersOnLine, 2023 - Elsevier
This paper is concerned with the controller synthesis problem for discrete-time unknown
systems against safety specifications via control barrier certificates. Typically, control barrier …

Formal abstraction of general stochastic systems via noise partitioning

J Skovbekk, L Laurenti, E Frew… - IEEE Control Systems …, 2023 - ieeexplore.ieee.org
Verifying the performance of safety-critical, stochastic systems with complex noise
distributions is difficult. We introduce a general procedure for the finite abstraction of …