A systematic survey of prompt engineering on vision-language foundation models

J Gu, Z Han, S Chen, A Beirami, B He, G Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Prompt engineering is a technique that involves augmenting a large pre-trained model with
task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be …

Not all prompts are secure: A switchable backdoor attack against pre-trained vision transfomers

S Yang, J Bai, K Gao, Y Yang, Y Li… - Proceedings of the …, 2024 - openaccess.thecvf.com
Given the power of vision transformers a new learning paradigm pre-training and then
prompting makes it more efficient and effective to address downstream visual recognition …

Defenses in adversarial machine learning: A survey

B Wu, S Wei, M Zhu, M Zheng, Z Zhu, M Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Adversarial phenomenon has been widely observed in machine learning (ML) systems,
especially in those using deep neural networks, describing that ML systems may produce …

Free fine-tuning: A plug-and-play watermarking scheme for deep neural networks

R Wang, J Ren, B Li, T She, W Zhang, L Fang… - Proceedings of the 31st …, 2023 - dl.acm.org
Watermarking has been widely adopted for protecting the intellectual property (IP) of Deep
Neural Networks (DNN) to defend the unauthorized distribution. Unfortunately, studies have …

On the Vulnerability of Skip Connections to Model Inversion Attacks

KJ Hao, ST Ho, NB Nguyen, NM Cheung - European Conference on …, 2024 - Springer
Skip connections are fundamental architecture designs for modern deep neural networks
(DNNs) such as CNNs and ViTs. While they help improve model performance significantly …

EmInspector: Combating Backdoor Attacks in Federated Self-Supervised Learning Through Embedding Inspection

Y Qian, S Wu, K Wei, M Ding, D **ao, T **ang… - arxiv preprint arxiv …, 2024 - arxiv.org
Federated self-supervised learning (FSSL) has recently emerged as a promising paradigm
that enables the exploitation of clients' vast amounts of unlabeled data while preserving data …

End-to-End Anti-Backdoor Learning on Images and Time Series

Y Jiang, X Ma, SM Erfani, Y Li, J Bailey - arxiv preprint arxiv:2401.03215, 2024 - arxiv.org
Backdoor attacks present a substantial security concern for deep learning models,
especially those utilized in applications critical to safety and security. These attacks …

Towards Sample-specific Backdoor Attack with Clean Labels via Attribute Trigger

Y Li, M Zhu, J Guo, T Wei, ST **a, Z Qin - arxiv preprint arxiv:2312.04584, 2023 - arxiv.org
Currently, sample-specific backdoor attacks (SSBAs) are the most advanced and malicious
methods since they can easily circumvent most of the current backdoor defenses. In this …

Learning from Distinction: Mitigating backdoors using a low-capacity model

H Sun, Y Li, X Lyu, J Ma - Proceedings of the 32nd ACM International …, 2024 - dl.acm.org
Deep neural networks (DNNs) are susceptible to backdoor attacks due to their black-box
nature and lack of interpretability. Backdoor attacks intend to manipulate the model's …

Evolutionary Trigger Detection and Lightweight Model Repair Based Backdoor Defense

Q Zhou, Z Ye, Y Tang, W Luo, Y Shi, Y Jia - arxiv preprint arxiv …, 2024 - arxiv.org
Deep Neural Networks (DNNs) have been widely used in many areas such as autonomous
driving and face recognition. However, DNN model is fragile to backdoor attack. A backdoor …