Medical visual question answering: A survey

Z Lin, D Zhang, Q Tao, D Shi, G Haffari, Q Wu… - Artificial Intelligence in …, 2023 - Elsevier
Abstract Medical Visual Question Answering (VQA) is a combination of medical artificial
intelligence and popular VQA challenges. Given a medical image and a clinically relevant …

Pmc-vqa: Visual instruction tuning for medical visual question answering

X Zhang, C Wu, Z Zhao, W Lin, Y Zhang… - ar** review on multimodal deep learning in biomedical images and texts
Z Sun, M Lin, Q Zhu, Q **e, F Wang, Z Lu… - Journal of Biomedical …, 2023 - Elsevier
Objective Computer-assisted diagnostic and prognostic systems of the future should be
capable of simultaneously processing multimodal data. Multimodal deep learning (MDL) …

Pmc-clip: Contrastive language-image pre-training using biomedical documents

W Lin, Z Zhao, X Zhang, C Wu, Y Zhang… - … Conference on Medical …, 2023 - Springer
Foundation models trained on large-scale dataset gain a recent surge in CV and NLP. In
contrast, development in biomedical domain lags far behind due to data scarcity. To address …

Multi-modal masked autoencoders for medical vision-and-language pre-training

Z Chen, Y Du, J Hu, Y Liu, G Li, X Wan… - … Conference on Medical …, 2022 - Springer
Medical vision-and-language pre-training provides a feasible solution to extract effective
vision-and-language representations from medical images and texts. However, few studies …

Align, reason and learn: Enhancing medical vision-and-language pre-training with knowledge

Z Chen, G Li, X Wan - Proceedings of the 30th ACM International …, 2022 - dl.acm.org
Medical vision-and-language pre-training (Med-VLP) has received considerable attention
owing to its applicability to extracting generic vision-and-language representations from …

Does clip benefit visual question answering in the medical domain as much as it does in the general domain?

S Eslami, G de Melo, C Meinel - arxiv preprint arxiv:2112.13906, 2021 - arxiv.org
Contrastive Language--Image Pre-training (CLIP) has shown remarkable success in
learning with cross-modal supervision from extensive amounts of image--text pairs collected …

Pubmedclip: How much does clip benefit visual question answering in the medical domain?

S Eslami, C Meinel, G De Melo - Findings of the Association for …, 2023 - aclanthology.org
Abstract Contrastive Language–Image Pre-training (CLIP) has shown remarkable success
in learning with cross-modal supervision from extensive amounts of image–text pairs …

Open-ended medical visual question answering through prefix tuning of language models

T Van Sonsbeek, MM Derakhshani… - … Conference on Medical …, 2023 - Springer
Abstract Medical Visual Question Answering (VQA) is an important challenge, as it would
lead to faster and more accurate diagnoses and treatment decisions. Most existing methods …

Towards unifying medical vision-and-language pre-training via soft prompts

Z Chen, S Diao, B Wang, G Li… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Medical vision-and-language pre-training (Med-VLP) has shown promising improvements
on many downstream medical tasks owing to its applicability to extracting generic …