Towards Risk‐Free Trustworthy Artificial Intelligence: Significance and Requirements

L Alzubaidi, A Al-Sabaawi, J Bai… - … Journal of Intelligent …, 2023 - Wiley Online Library
Given the tremendous potential and influence of artificial intelligence (AI) and algorithmic
decision‐making (DM), these systems have found wide‐ranging applications across diverse …

Verifying generalization in deep learning

G Amir, O Maayan, T Zelazny, G Katz… - … Conference on Computer …, 2023 - Springer
Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the
state of the art in numerous application domains. However, DNN-based decision rules are …

Critically assessing the state of the art in neural network verification

M König, AW Bosman, HH Hoos, JN van Rijn - Journal of Machine …, 2024 - jmlr.org
Recent research has proposed various methods to formally verify neural networks against
minimal input perturbations; this verification task is also known as local robustness …

[PDF][PDF] Formally Explaining Neural Networks within Reactive Systems

S Bassan, G Amir, D Corsi, I Refaeli… - 2023 Formal Methods in …, 2023 - library.oapen.org
Deep neural networks (DNNs) are increasingly being used as controllers in reactive
systems. However, DNNs are highly opaque, which renders it difficult to explain and justify …

Analyzing Adversarial Inputs in Deep Reinforcement Learning

D Corsi, G Amir, G Katz, A Farinelli - arxiv preprint arxiv:2402.05284, 2024 - arxiv.org
In recent years, Deep Reinforcement Learning (DRL) has become a popular paradigm in
machine learning due to its successful applications to real-world and complex systems …

Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates

U Mandal, G Amir, H Wu, I Daukantas… - arxiv preprint arxiv …, 2024 - arxiv.org
Deep reinforcement learning (DRL) is a powerful machine learning paradigm for generating
agents that control autonomous systems. However, the" black box" nature of DRL agents …

veriFIRE: verifying an industrial, learning-based wildfire detection system

G Amir, Z Freund, G Katz, E Mandelbaum… - … Symposium on Formal …, 2023 - Springer
In this short paper, we present our ongoing work on the veriFIRE project—a collaboration
between industry and academia, aimed at using verification for increasing the reliability of a …

Logic of differentiable logics: Towards a uniform semantics of DL

N Ślusarz, E Komendantskaya, ML Daggitt… - arxiv preprint arxiv …, 2023 - arxiv.org
Differentiable logics (DL) have recently been proposed as a method of training neural
networks to satisfy logical specifications. A DL consists of a syntax in which specifications …

Monitizer: automating design and evaluation of neural network monitors

M Azeem, M Grobelna, S Kanav, J Křetínský… - … on Computer Aided …, 2024 - Springer
The behavior of neural networks (NNs) on previously unseen types of data (out-of-
distribution or OOD) is typically unpredictable. This can be dangerous if the network's output …

Comparing differentiable logics for learning with logical constraints

T Flinkow, BA Pearlmutter, R Monahan - arxiv preprint arxiv:2407.03847, 2024 - arxiv.org
Extensive research on formal verification of machine learning systems indicates that
learning from data alone often fails to capture underlying background knowledge such as …