Interpretability research of deep learning: A literature survey

B Xua, G Yang - Information Fusion, 2024 - Elsevier
Deep learning (DL) has been widely used in various fields. However, its black-box nature
limits people's understanding and trust in its decision-making process. Therefore, it becomes …

Evaluating post-hoc explanations for graph neural networks via robustness analysis

J Fang, W Liu, Y Gao, Z Liu, A Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
This work studies the evaluation of explaining graph neural networks (GNNs), which is
crucial to the credibility of post-hoc explainability in practical usage. Conventional evaluation …

Craft: Concept recursive activation factorization for explainability

T Fel, A Picard, L Bethune, T Boissin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Attribution methods are a popular class of explainability methods that use heatmaps to
depict the most important areas of an image that drive a model decision. Nevertheless …

Harmonizing the object recognition strategies of deep neural networks with humans

T Fel, IF Rodriguez Rodriguez… - Advances in neural …, 2022 - proceedings.neurips.cc
The many successes of deep neural networks (DNNs) over the past decade have largely
been driven by computational scale rather than insights from biological intelligence. Here …

What i cannot predict, i do not understand: A human-centered evaluation framework for explainability methods

J Colin, T Fel, R Cadène… - Advances in neural …, 2022 - proceedings.neurips.cc
A multitude of explainability methods has been described to try to help users better
understand how modern AI systems make decisions. However, most performance metrics …

A holistic approach to unifying automatic concept extraction and concept importance estimation

T Fel, V Boutin, L Béthune, R Cadène… - Advances in …, 2024 - proceedings.neurips.cc
In recent years, concept-based approaches have emerged as some of the most promising
explainability methods to help us interpret the decisions of Artificial Neural Networks (ANNs) …

Keep the faith: Faithful explanations in convolutional neural networks for case-based reasoning

TN Wolf, F Bongratz, AM Rickmann, S Pölsterl… - Proceedings of the …, 2024 - ojs.aaai.org
Explaining predictions of black-box neural networks is crucial when applied to decision-
critical tasks. Thus, attribution maps are commonly used to identify important image regions …

Xplique: A deep learning explainability toolbox

T Fel, L Hervier, D Vigouroux, A Poche… - arxiv preprint arxiv …, 2022 - arxiv.org
Today's most advanced machine-learning models are hardly scrutable. The key challenge
for explainability methods is to help assisting researchers in opening up these black boxes …

[PDF][PDF] Formally Explaining Neural Networks within Reactive Systems

S Bassan, G Amir, D Corsi, I Refaeli… - 2023 Formal Methods in …, 2023 - library.oapen.org
Deep neural networks (DNNs) are increasingly being used as controllers in reactive
systems. However, DNNs are highly opaque, which renders it difficult to explain and justify …

Manifold-based shapley explanations for high dimensional correlated features

X Hu, M Zhu, Z Feng, L Stanković - Neural Networks, 2024 - Elsevier
Explainable artificial intelligence (XAI) holds significant importance in enhancing the
reliability and transparency of network decision-making. SHapley Additive exPlanations …