Artificial intelligence for safety-critical systems in industrial and transportation domains: A survey

J Perez-Cerrolaza, J Abella, M Borg, C Donzella… - ACM Computing …, 2024 - dl.acm.org
Artificial Intelligence (AI) can enable the development of next-generation autonomous safety-
critical systems in which Machine Learning (ML) algorithms learn optimized and safe …

Testing, validation, and verification of robotic and autonomous systems: a systematic review

H Araujo, MR Mousavi, M Varshosaz - ACM Transactions on Software …, 2023 - dl.acm.org
We perform a systematic literature review on testing, validation, and verification of robotic
and autonomous systems (RAS). The scope of this review covers peer-reviewed research …

NNV: the neural network verification tool for deep neural networks and learning-enabled cyber-physical systems

HD Tran, X Yang, D Manzanas Lopez, P Musau… - … on Computer Aided …, 2020 - Springer
This paper presents the Neural Network Verification (NNV) software tool, a set-based
verification framework for deep neural networks (DNNs) and learning-enabled cyber …

Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arxiv preprint arxiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Verification of deep convolutional neural networks using imagestars

HD Tran, S Bak, W **ang, TT Johnson - International conference on …, 2020 - Springer
Abstract Convolutional Neural Networks (CNN) have redefined state-of-the-art in many real-
world applications, such as facial recognition, image classification, human pose estimation …

An abstraction-based framework for neural network verification

YY Elboher, J Gottschlich, G Katz - … , CAV 2020, Los Angeles, CA, USA …, 2020 - Springer
Deep neural networks are increasingly being used as controllers for safety-critical systems.
Because neural networks are opaque, certifying their correctness is a significant challenge …

Verisig 2.0: Verification of neural network controllers using taylor model preconditioning

R Ivanov, T Carpenter, J Weimer, R Alur… - … on Computer Aided …, 2021 - Springer
Abstract This paper presents Verisig 2.0, a verification tool for closed-loop systems with
neural network (NN) controllers. We focus on NNs with tanh/sigmoid activations and develop …

Neurosymbolic reinforcement learning with formally verified exploration

G Anderson, A Verma, I Dillig… - Advances in neural …, 2020 - proceedings.neurips.cc
We present REVEL, a partially neural reinforcement learning (RL) framework for provably
safe exploration in continuous state and action spaces. A key challenge for provably safe …

Safety verification of cyber-physical systems with reinforcement learning control

HD Tran, F Cai, ML Diego, P Musau… - ACM Transactions on …, 2019 - dl.acm.org
This paper proposes a new forward reachability analysis approach to verify safety of cyber-
physical systems (CPS) with reinforcement learning controllers. The foundation of our …

Verifying learning-augmented systems

T Eliyahu, Y Kazak, G Katz, M Schapira - Proceedings of the 2021 ACM …, 2021 - dl.acm.org
The application of deep reinforcement learning (DRL) to computer and networked systems
has recently gained significant popularity. However, the obscurity of decisions by DRL …