You are catching my attention: Are vision transformers bad learners under backdoor attacks?

Z Yuan, P Zhou, K Zou… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Abstract Vision Transformers (ViTs), which made a splash in the field of computer vision
(CV), have shaken the dominance of convolutional neural networks (CNNs). However, in the …

Not all prompts are secure: A switchable backdoor attack against pre-trained vision transfomers

S Yang, J Bai, K Gao, Y Yang, Y Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Given the power of vision transformers a new learning paradigm pre-training and then
prompting makes it more efficient and effective to address downstream visual recognition …

Trojvit: Trojan insertion in vision transformers

M Zheng, Q Lou, L Jiang - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Abstract Vision Transformers (ViTs) have demonstrated the state-of-the-art performance in
various vision-related tasks. The success of ViTs motivates adversaries to perform backdoor …

A data-free backdoor injection approach in neural networks

P Lv, C Yue, R Liang, Y Yang, S Zhang, H Ma… - 32nd USENIX Security …, 2023 - usenix.org
Recently, the backdoor attack on deep neural networks (DNNs) has been extensively
studied, which causes the backdoored models to behave well on benign samples, whereas …

Defending backdoor attacks on vision transformer via patch processing

KD Doan, Y Lao, P Yang, P Li - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
Abstract Vision Transformers (ViTs) have a radically different architecture with significantly
less inductive bias than Convolutional Neural Networks. Along with the improvement in …

Reverse backdoor distillation: Towards online backdoor attack detection for deep neural network models

Z Yao, H Zhang, Y Guo, X Tian, W Peng… - … on Dependable and …, 2024 - ieeexplore.ieee.org
The backdoor attack on deep neural network models implants malicious data patterns in a
model to induce attacker-desirable behaviors. Existing defense methods fall into the online …

A closer look at robustness of vision transformers to backdoor attacks

A Subramanya, SA Koohpayegani… - Proceedings of the …, 2024 - openaccess.thecvf.com
Transformer architectures are based on self-attention mechanism that processes images as
a sequence of patches. As their design is quite different compared to CNNs, it is important to …

Randomized channel shuffling: Minimal-overhead backdoor attack detection without clean datasets

R Cai, Z Zhang, T Chen, X Chen… - Advances in Neural …, 2022 - proceedings.neurips.cc
Deep neural networks (DNNs) typically require massive data to train on, which is a hurdle for
numerous practical domains. Facing the data shortfall, one viable option is to acquire …

Backdoor attacks with wavelet embedding: revealing and enhancing the insights of vulnerabilities in visual object detection models on transformers within digital twin …

M Shen, R Huang - Advanced Engineering Informatics, 2024 - Elsevier
Given the pervasive use of deep learning models across various domains, ensuring model
security has emerged as a critical concern. This paper examines backdoor attacks, a form of …

Backdoor attacks on vision transformers

A Subramanya, A Saha, SA Koohpayegani… - arxiv preprint arxiv …, 2022 - arxiv.org
Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety
of vision tasks and are being used as an alternative to CNNs. Their design is based on a self …