Decision trees: from efficient prediction to responsible AI

H Blockeel, L Devos, B Frénay, G Nanfack… - Frontiers in artificial …, 2023 - frontiersin.org
This article provides a birds-eye view on the role of decision trees in machine learning and
data science over roughly four decades. It sketches the evolution of decision tree research …

A review of formal methods applied to machine learning

C Urban, A Miné - arxiv preprint arxiv:2104.02466, 2021 - arxiv.org
We review state-of-the-art formal methods applied to the emerging field of the verification of
machine learning systems. Formal methods can provide rigorous correctness guarantees on …

Are formal methods applicable to machine learning and artificial intelligence?

M Krichen, A Mihoub, MY Alzahrani… - … Conference of Smart …, 2022 - ieeexplore.ieee.org
Formal approaches can provide strict correctness guarantees for the development of both
hardware and software systems. In this work, we examine state-of-the-art formal methods for …

On explaining random forests with SAT

Y Izza, J Marques-Silva - arxiv preprint arxiv:2105.10278, 2021 - arxiv.org
Random Forest (RFs) are among the most widely used Machine Learning (ML) classifiers.
Even though RFs are not interpretable, there are no dedicated non-heuristic approaches for …

Robustness verification of tree-based models

H Chen, H Zhang, S Si, Y Li… - Advances in Neural …, 2019 - proceedings.neurips.cc
We study the robustness verification problem of tree based models, including random forest
(RF) and gradient boosted decision tree (GBDT). Formal robustness verification of decision …

[HTML][HTML] Gradient boosting Bayesian neural networks via Langevin MCMC

G Bai, R Chandra - Neurocomputing, 2023 - Elsevier
Bayesian neural networks harness the power of Bayesian inference which provides an
approach to neural learning that not only focuses on accuracy but also uncertainty …

Abstract interpretation of decision tree ensemble classifiers

F Ranzato, M Zanella - Proceedings of the AAAI Conference on Artificial …, 2020 - ojs.aaai.org
We study the problem of formally and automatically verifying robustness properties of
decision tree ensemble classifiers such as random forests and gradient boosted decision …

Forest GUMP: a tool for verification and explanation

A Murtovi, A Bainczyk, G Nolte, M Schlüter… - International Journal on …, 2023 - Springer
In this paper, we present Forest GUMP (for Generalized, Unifying Merge Process) a tool for
verification and precise explanation of Random forests. Besides pre/post-condition-based …

Evolving gradient boost: A pruning scheme based on loss improvement ratio for learning under concept drift

K Wang, J Lu, A Liu, G Zhang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
In nonstationary environments, data distributions can change over time. This phenomenon is
known as concept drift, and the related models need to adapt if they are to remain accurate …

An abstraction-refinement approach to formal verification of tree ensembles

J Törnblom, S Nadjm-Tehrani - … , and WAISE, Turku, Finland, September 10 …, 2019 - Springer
Recent advances in machine learning are now being considered for integration in safety-
critical systems such as vehicles, medical equipment and critical infrastructure. However …