Artificial intelligence in histopathology: enhancing cancer research and clinical oncology

A Shmatko, N Ghaffari Laleh, M Gerstung, JN Kather - Nature cancer, 2022‏ - nature.com
Artificial intelligence (AI) methods have multiplied our capabilities to extract quantitative
information from digital histopathology images. AI is expected to reduce workload for human …

Transformers in medical imaging: A survey

F Shamshad, S Khan, SW Zamir, MH Khan… - Medical Image …, 2023‏ - Elsevier
Following unprecedented success on the natural language tasks, Transformers have been
successfully applied to several computer vision problems, achieving state-of-the-art results …

Multimodal learning with transformers: A survey

P Xu, X Zhu, DA Clifton - IEEE Transactions on Pattern Analysis …, 2023‏ - ieeexplore.ieee.org
Transformer is a promising neural network learner, and has achieved great success in
various machine learning tasks. Thanks to the recent prevalence of multimodal applications …

Scaling up your kernels to 31x31: Revisiting large kernel design in cnns

X Ding, X Zhang, J Han, G Ding - Proceedings of the IEEE …, 2022‏ - openaccess.thecvf.com
We revisit large kernel design in modern convolutional neural networks (CNNs). Inspired by
recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few …

Daformer: Improving network architectures and training strategies for domain-adaptive semantic segmentation

L Hoyer, D Dai, L Van Gool - Proceedings of the IEEE/CVF …, 2022‏ - openaccess.thecvf.com
As acquiring pixel-wise annotations of real-world images for semantic segmentation is a
costly process, a model can instead be trained with more accessible synthetic data and …

Do vision transformers see like convolutional neural networks?

M Raghu, T Unterthiner, S Kornblith… - Advances in neural …, 2021‏ - proceedings.neurips.cc
Convolutional neural networks (CNNs) have so far been the de-facto model for visual data.
Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or …

Understanding the robustness in vision transformers

D Zhou, Z Yu, E **e, C **ao… - International …, 2022‏ - proceedings.mlr.press
Recent studies show that Vision Transformers (ViTs) exhibit strong robustness against
various corruptions. Although this property is partly attributed to the self-attention …

Are transformers more robust than cnns?

Y Bai, J Mei, AL Yuille, C **e - Advances in neural …, 2021‏ - proceedings.neurips.cc
Transformer emerges as a powerful tool for visual recognition. In addition to demonstrating
competitive performance on a broad range of visual benchmarks, recent works also argue …

Intriguing properties of vision transformers

MM Naseer, K Ranasinghe, SH Khan… - Advances in …, 2021‏ - proceedings.neurips.cc
Vision transformers (ViT) have demonstrated impressive performance across numerous
machine vision tasks. These models are based on multi-head self-attention mechanisms that …

Exploring the limits of out-of-distribution detection

S Fort, J Ren… - Advances in Neural …, 2021‏ - proceedings.neurips.cc
Near out-of-distribution detection (OOD) is a major challenge for deep neural networks. We
demonstrate that large-scale pre-trained transformers can significantly improve the state-of …