How to certify machine learning based safety-critical systems? A systematic literature review

F Tambon, G Laberge, L An, A Nikanjam… - Automated Software …, 2022 - Springer
Abstract Context Machine Learning (ML) has been at the heart of many innovations over the
past years. However, including it in so-called “safety-critical” systems such as automotive or …

Learning to be safe: Deep rl with a safety critic

K Srinivasan, B Eysenbach, S Ha, J Tan… - arxiv preprint arxiv …, 2020 - arxiv.org
Safety is an essential component for deploying reinforcement learning (RL) algorithms in
real-world scenarios, and is critical during the learning process itself. A natural first approach …

Robustness verification for transformers

Z Shi, H Zhang, KW Chang, M Huang… - arxiv preprint arxiv …, 2020 - arxiv.org
Robustness verification that aims to formally certify the prediction behavior of neural
networks has become an important tool for understanding model behavior and obtaining …

Robustness verification of tree-based models

H Chen, H Zhang, S Si, Y Li… - Advances in Neural …, 2019 - proceedings.neurips.cc
We study the robustness verification problem of tree based models, including random forest
(RF) and gradient boosted decision tree (GBDT). Formal robustness verification of decision …

Guaranteeing safety for neural network-based aircraft collision avoidance systems

KD Julian, MJ Kochenderfer - 2019 IEEE/AIAA 38th Digital …, 2019 - ieeexplore.ieee.org
The decision logic for the ACAS X family of aircraft collision avoidance systems is
represented as a large numeric table. Due to storage constraints of certified avionics …

[LIBRO][B] Adversarial robustness for machine learning

PY Chen, CJ Hsieh - 2022 - books.google.com
Adversarial Robustness for Machine Learning summarizes the recent progress on this topic
and introduces popular algorithms on adversarial attack, defense and veri? cation. Sections …

[PDF][PDF] Verifying strategic abilities of neural-symbolic multi-agent systems

ME Akintunde, E Botoeva, P Kouvaros… - Proceedings of the …, 2020 - doc.ic.ac.uk
We investigate the problem of verifying the strategic properties of multi-agent systems
equipped with machine learningbased perception units. We introduce a novel model of …

Reachability analysis for neural network aircraft collision avoidance systems

KD Julian, MJ Kochenderfer - Journal of Guidance, Control, and …, 2021 - arc.aiaa.org
Sequential decision-making problems can be modeled as Markov decision processes and
solved with value iteration to produce a table of values. However, the numeric table can be …

Evaluation of neural network verification methods for air-to-air collision avoidance

D Manzanas Lopez, TT Johnson, S Bak… - Journal of Air …, 2023 - arc.aiaa.org
Neural network approximations have become attractive to compress data for automation and
autonomy algorithms for use on storage-limited and processing-limited aerospace …

Probabilistic model checking for strategic equilibria-based decision making: Advances and challenges

M Kwiatkowska, G Norman, D Parker, G Santos… - arxiv preprint arxiv …, 2022 - arxiv.org
Game-theoretic concepts have been extensively studied in economics to provide insight into
competitive behaviour and strategic decision making. As computing systems increasingly …