Towards Risk‐Free Trustworthy Artificial Intelligence: Significance and Requirements
Given the tremendous potential and influence of artificial intelligence (AI) and algorithmic
decision‐making (DM), these systems have found wide‐ranging applications across diverse …
decision‐making (DM), these systems have found wide‐ranging applications across diverse …
Verifying generalization in deep learning
Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the
state of the art in numerous application domains. However, DNN-based decision rules are …
state of the art in numerous application domains. However, DNN-based decision rules are …
Critically assessing the state of the art in neural network verification
Recent research has proposed various methods to formally verify neural networks against
minimal input perturbations; this verification task is also known as local robustness …
minimal input perturbations; this verification task is also known as local robustness …
[PDF][PDF] Formally Explaining Neural Networks within Reactive Systems
Deep neural networks (DNNs) are increasingly being used as controllers in reactive
systems. However, DNNs are highly opaque, which renders it difficult to explain and justify …
systems. However, DNNs are highly opaque, which renders it difficult to explain and justify …
Analyzing Adversarial Inputs in Deep Reinforcement Learning
In recent years, Deep Reinforcement Learning (DRL) has become a popular paradigm in
machine learning due to its successful applications to real-world and complex systems …
machine learning due to its successful applications to real-world and complex systems …
Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates
Deep reinforcement learning (DRL) is a powerful machine learning paradigm for generating
agents that control autonomous systems. However, the" black box" nature of DRL agents …
agents that control autonomous systems. However, the" black box" nature of DRL agents …
veriFIRE: verifying an industrial, learning-based wildfire detection system
In this short paper, we present our ongoing work on the veriFIRE project—a collaboration
between industry and academia, aimed at using verification for increasing the reliability of a …
between industry and academia, aimed at using verification for increasing the reliability of a …
Logic of differentiable logics: Towards a uniform semantics of DL
Differentiable logics (DL) have recently been proposed as a method of training neural
networks to satisfy logical specifications. A DL consists of a syntax in which specifications …
networks to satisfy logical specifications. A DL consists of a syntax in which specifications …
Monitizer: automating design and evaluation of neural network monitors
The behavior of neural networks (NNs) on previously unseen types of data (out-of-
distribution or OOD) is typically unpredictable. This can be dangerous if the network's output …
distribution or OOD) is typically unpredictable. This can be dangerous if the network's output …
Comparing differentiable logics for learning with logical constraints
Extensive research on formal verification of machine learning systems indicates that
learning from data alone often fails to capture underlying background knowledge such as …
learning from data alone often fails to capture underlying background knowledge such as …