A review of formal methods applied to machine learning

C Urban, A Miné - arxiv preprint arxiv:2104.02466, 2021 - arxiv.org
We review state-of-the-art formal methods applied to the emerging field of the verification of
machine learning systems. Formal methods can provide rigorous correctness guarantees on …

Sok: Certified robustness for deep neural networks

L Li, T **e, B Li - 2023 IEEE symposium on security and privacy …, 2023 - ieeexplore.ieee.org
Great advances in deep neural networks (DNNs) have led to state-of-the-art performance on
a wide range of tasks. However, recent studies have shown that DNNs are vulnerable to …

Introduction to neural network verification

A Albarghouthi - Foundations and Trends® in Programming …, 2021 - nowpublishers.com
Deep learning has transformed the way we think of software and what it can do. But deep
neural networks are fragile and their behaviors are often surprising. In many settings, we …

Mathematical theory of deep learning

P Petersen, J Zech - arxiv preprint arxiv:2407.18384, 2024 - arxiv.org
This book provides an introduction to the mathematical analysis of deep learning. It covers
fundamental results in approximation theory, optimization theory, and statistical learning …

Understanding certified training with interval bound propagation

Y Mao, MN Müller, M Fischer, M Vechev - arxiv preprint arxiv:2306.10426, 2023 - arxiv.org
As robustness verification methods are becoming more precise, training certifiably robust
neural networks is becoming ever more relevant. To this end, certified training methods …

Expressivity of reLU-networks under convex relaxations

M Baader, MN Müller, Y Mao, M Vechev - arxiv preprint arxiv:2311.04015, 2023 - arxiv.org
Convex relaxations are a key component of training and certifying provably safe neural
networks. However, despite substantial progress, a wide and poorly understood accuracy …

[HTML][HTML] Synergies between machine learning and reasoning-An introduction by the Kay R. Amel group

I Baaj, Z Bouraoui, A Cornuéjols, T Denœux… - International Journal of …, 2024 - Elsevier
This paper proposes a tentative and original survey of meeting points between Knowledge
Representation and Reasoning (KRR) and Machine Learning (ML), two areas which have …

Interval universal approximation for neural networks

Z Wang, A Albarghouthi, G Prakriya, S Jha - Proceedings of the ACM on …, 2022 - dl.acm.org
To verify safety and robustness of neural networks, researchers have successfully applied
abstract interpretation, primarily using the interval abstract domain. In this paper, we study …

On the paradox of certified training

N Jovanović, M Balunović, M Baader… - arxiv preprint arxiv …, 2021 - arxiv.org
Certified defenses based on convex relaxations are an established technique for training
provably robust models. The key component is the choice of relaxation, varying from simple …

On the convergence of certified robust training with interval bound propagation

Y Wang, Z Shi, Q Gu, CJ Hsieh - arxiv preprint arxiv:2203.08961, 2022 - arxiv.org
Interval Bound Propagation (IBP) is so far the base of state-of-the-art methods for training
neural networks with certifiable robustness guarantees when potential adversarial …