A review of safe reinforcement learning: Methods, theories and applications
Reinforcement Learning (RL) has achieved tremendous success in many complex decision-
making tasks. However, safety concerns are raised during deploying RL in real-world …
making tasks. However, safety concerns are raised during deploying RL in real-world …
Exact verification of relu neural control barrier functions
Abstract Control Barrier Functions (CBFs) are a popular approach for safe control of
nonlinear systems. In CBF-based control, the desired safety properties of the system are …
nonlinear systems. In CBF-based control, the desired safety properties of the system are …
Compositional policy learning in stochastic control systems with formal guarantees
Reinforcement learning has shown promising results in learning neural network policies for
complicated control tasks. However, the lack of formal guarantees about the behavior of …
complicated control tasks. However, the lack of formal guarantees about the behavior of …
Learning control policies for stochastic systems with reach-avoid guarantees
We study the problem of learning controllers for discrete-time non-linear stochastic
dynamical systems with formal reach-avoid guarantees. This work presents the first method …
dynamical systems with formal reach-avoid guarantees. This work presents the first method …
Unifying qualitative and quantitative safety verification of DNN-controlled systems
The rapid advance of deep reinforcement learning techniques enables the oversight of
safety-critical systems through the utilization of Deep Neural Networks (DNNs). This …
safety-critical systems through the utilization of Deep Neural Networks (DNNs). This …
Verification of neural control barrier functions with symbolic derivative bounds propagation
Control barrier functions (CBFs) are important in safety-critical systems and robot control
applications. Neural networks have been used to parameterize and synthesize CBFs with …
applications. Neural networks have been used to parameterize and synthesize CBFs with …
Data-driven invariant set for nonlinear systems with application to command governors
A Kashani, C Danielson - Automatica, 2025 - Elsevier
This paper presents a novel approach to synthesize positive invariant sets for unmodeled
nonlinear systems using direct data-driven techniques. The data-driven invariant sets are …
nonlinear systems using direct data-driven techniques. The data-driven invariant sets are …
Formal abstraction of general stochastic systems via noise partitioning
Verifying the performance of safety-critical, stochastic systems with complex noise
distributions is difficult. We introduce a general procedure for the finite abstraction of …
distributions is difficult. We introduce a general procedure for the finite abstraction of …
Fossil 2.0: Formal Certificate Synthesis for the Verification and Control of Dynamical Models
This paper presents Fossil 2.0, a new major release of a software tool for the synthesis of
certificates (eg, Lyapunov and barrier functions) for dynamical systems modelled as ordinary …
certificates (eg, Lyapunov and barrier functions) for dynamical systems modelled as ordinary …
Simultaneous synthesis and verification of neural control barrier functions through branch-and-bound verification-in-the-loop training
X Wang, L Knoedler, FB Mathiesen… - 2024 European …, 2024 - ieeexplore.ieee.org
Control Barrier Functions (CBFs) that provide formal safety guarantees have been widely
used for safety-critical systems. However, it is non-trivial to design a CBF. Utilizing neural …
used for safety-critical systems. However, it is non-trivial to design a CBF. Utilizing neural …