Vlp: A survey on vision-language pre-training

FL Chen, DZ Zhang, ML Han, XY Chen, J Shi… - Machine Intelligence …, 2023 - Springer
In the past few years, the emergence of pre-training models has brought uni-modal fields
such as computer vision (CV) and natural language processing (NLP) to a new era …

Teach me to explain: A review of datasets for explainable natural language processing

S Wiegreffe, A Marasović - arxiv preprint arxiv:2102.12060, 2021 - arxiv.org
Explainable NLP (ExNLP) has increasingly focused on collecting human-annotated textual
explanations. These explanations are used downstream in three ways: as data …

Formalizing trust in artificial intelligence: Prerequisites, causes and goals of human trust in AI

A Jacovi, A Marasović, T Miller… - Proceedings of the 2021 …, 2021 - dl.acm.org
Trust is a central component of the interaction between people and AI, in that'incorrect'levels
of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the …

Language models are general-purpose interfaces

Y Hao, H Song, L Dong, S Huang, Z Chi… - arxiv preprint arxiv …, 2022 - arxiv.org
Foundation models have received much attention due to their effectiveness across a broad
range of downstream applications. Though there is a big convergence in terms of …

Few-shot self-rationalization with natural language prompts

A Marasović, I Beltagy, D Downey… - arxiv preprint arxiv …, 2021 - arxiv.org
Self-rationalization models that predict task labels and generate free-text elaborations for
their predictions could enable more intuitive interaction with NLP systems. These models …

Nlx-gpt: A model for natural language explanations in vision and vision-language tasks

F Sammani, T Mukherjee… - proceedings of the …, 2022 - openaccess.thecvf.com
Natural language explanation (NLE) models aim at explaining the decision-making process
of a black box system via generating natural language sentences which are human-friendly …

e-vil: A dataset and benchmark for natural language explanations in vision-language tasks

M Kayser, OM Camburu, L Salewski… - Proceedings of the …, 2021 - openaccess.thecvf.com
Recently, there has been an increasing number of efforts to introduce models capable of
generating natural language explanations (NLEs) for their predictions on vision-language …

Artificial Intelligence (AI) trust framework and maturity model: applying an entropy lens to improve security, privacy, and ethical AI

M Mylrea, N Robinson - Entropy, 2023 - mdpi.com
Recent advancements in artificial intelligence (AI) technology have raised concerns about
the ethical, moral, and legal safeguards. There is a pressing need to improve metrics for …

Multimodal explainable artificial intelligence: A comprehensive review of methodological advances and future research directions

N Rodis, C Sardianos, P Radoglou-Grammatikis… - IEEE …, 2024 - ieeexplore.ieee.org
Despite the fact that Artificial Intelligence (AI) has boosted the achievement of remarkable
results across numerous data analysis tasks, however, this is typically accompanied by a …

Beyond task performance: Evaluating and reducing the flaws of large multimodal models with in-context learning

M Shukor, A Rame, C Dancette, M Cord - arxiv preprint arxiv:2310.00647, 2023 - arxiv.org
Following the success of Large Language Models (LLMs), Large Multimodal Models
(LMMs), such as the Flamingo model and its subsequent competitors, have started to …