Recent progress in transformer-based medical image analysis

Z Liu, Q Lv, Z Yang, Y Li, CH Lee, L Shen - Computers in Biology and …, 2023 - Elsevier
The transformer is primarily used in the field of natural language processing. Recently, it has
been adopted and shows promise in the computer vision (CV) field. Medical image analysis …

A survey of visual transformers

Y Liu, Y Zhang, Y Wang, F Hou, J Yuan… - … on Neural Networks …, 2023 - ieeexplore.ieee.org
Transformer, an attention-based encoder–decoder model, has already revolutionized the
field of natural language processing (NLP). Inspired by such significant achievements, some …

[HTML][HTML] Vision transformers in multi-modal brain tumor MRI segmentation: A review

P Wang, Q Yang, Z He, Y Yuan - Meta-Radiology, 2023 - Elsevier
Brain tumors have shown extreme mortality and increasing incidence during recent years,
which bring enormous challenges for the timely diagnosis and effective treatment of brain …

Multi-modal learning with missing modality via shared-specific feature modelling

H Wang, Y Chen, C Ma, J Avery… - Proceedings of the …, 2023 - openaccess.thecvf.com
The missing modality issue is critical but non-trivial to be solved by multi-modal models.
Current methods aiming to handle the missing modality problem in multi-modal tasks, either …

TranSiam: Aggregating multi-modal visual features with locality for medical image segmentation

X Li, S Ma, J Xu, J Tang, S He, F Guo - Expert Systems with Applications, 2024 - Elsevier
Automatic segmentation of medical images plays an important role in the diagnosis of
diseases. On single-modal data, convolutional neural networks have demonstrated …

Multi-modal medical Transformers: A meta-analysis for medical image segmentation in oncology

G Andrade-Miranda, V Jaouen, O Tankyevych… - … Medical Imaging and …, 2023 - Elsevier
Multi-modal medical image segmentation is a crucial task in oncology that enables the
precise localization and quantification of tumors. The aim of this work is to present a meta …

One model to rule them all: Towards universal segmentation for medical images with text prompts

Z Zhao, Y Zhang, C Wu, X Zhang, Y Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
In this study, we focus on building up a model that can Segment Anything in medical
scenarios, driven by Text prompts, termed as SAT. Our main contributions are three folds:(i) …

Recent deep learning-based brain tumor segmentation models using multi-modality magnetic resonance imaging: A prospective survey

ZU Abidin, RA Naqvi, A Haider, HS Kim… - … in Bioengineering and …, 2024 - frontiersin.org
Radiologists encounter significant challenges when segmenting and determining brain
tumors in patients because this information assists in treatment planning. The utilization of …

Enhancing modality-agnostic representations via meta-learning for brain tumor segmentation

A Konwer, X Hu, J Bae, X Xu… - Proceedings of the …, 2023 - openaccess.thecvf.com
In medical vision, different imaging modalities provide complementary information. However,
in practice, not all modalities may be available during inference or even training. Previous …

MMANet: Margin-aware distillation and modality-aware regularization for incomplete multimodal learning

S Wei, C Luo, Y Luo - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Multimodal learning has shown great potentials in numerous scenes and attracts increasing
interest recently. However, it often encounters the problem of missing modality data and thus …