Development and validation of a multimodal multitask vision foundation model for generalist ophthalmic artificial intelligence

J Qiu, J Wu, H Wei, P Shi, M Zhang, Y Sun, L Li, H Liu… - NEJM AI, 2024 - ai.nejm.org
Background Specialized single-use, single-modality models often have limited or no
generalization to new diseases, modalities, and clinical tasks. Foundation models are built …

Visual-Textual Integration in LLMs for Medical Diagnosis: A Quantitative Analysis

R Agbareia, M Omar Sr, S Soffer Sr, BS Glicksberg… - medRxiv, 2024 - medrxiv.org
Background and Aim: Visual data from images is essential for many medical diagnoses. This
study evaluates the performance of multimodal Large Language Models (LLMs) in …