Deep model reassembly

X Yang, D Zhou, S Liu, J Ye… - Advances in neural …, 2022 - proceedings.neurips.cc
In this paper, we explore a novel knowledge-transfer task, termed as Deep Model
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …

Breaking the data barrier: a review of deep learning techniques for democratizing AI with small datasets

IH Rather, S Kumar, AH Gandomi - Artificial Intelligence Review, 2024 - Springer
Justifiably, while big data is the primary interest of research and public discourse, it is
essential to acknowledge that small data remains prevalent. The same technological and …

A survey on negative transfer

W Zhang, L Deng, L Zhang, D Wu - IEEE/CAA Journal of …, 2022 - ieeexplore.ieee.org
Transfer learning (TL) utilizes data or knowledge from one or more source domains to
facilitate learning in a target domain. It is particularly useful when the target domain has very …

How far pre-trained models are from neural collapse on the target dataset informs their transferability

Z Wang, Y Luo, L Zheng, Z Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper focuses on model transferability estimation, ie, assessing the performance of pre-
trained models on a downstream task without performing fine-tuning. Motivated by the …

Leep: A new measure to evaluate transferability of learned representations

C Nguyen, T Hassner, M Seeger… - International …, 2020 - proceedings.mlr.press
We introduce a new measure to evaluate the transferability of representations learned by
classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy …

Transferability estimation using bhattacharyya class separability

M Pándy, A Agostinelli, J Uijlings… - Proceedings of the …, 2022 - openaccess.thecvf.com
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …

Sensitivity-aware visual parameter-efficient fine-tuning

H He, J Cai, J Zhang, D Tao… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Visual Parameter-Efficient Fine-Tuning (PEFT) has become a powerful alternative
for full fine-tuning so as to adapt pre-trained vision models to downstream tasks, which only …

CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community

Y Liu, B Guo, N Li, Y Ding, Z Zhang… - … Surveys & Tutorials, 2024 - ieeexplore.ieee.org
Artificial Intelligence of Things (AIoT) is an emerging frontier based on the deep fusion of
Internet of Things (IoT) and Artificial Intelligence (AI) technologies. The fundamental goal of …

Exploring model transferability through the lens of potential energy

X Li, Z Hu, Y Ge, Y Shan… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Transfer learning has become crucial in computer vision tasks due to the vast availability of
pre-trained deep learning models. However, selecting the optimal pre-trained model from a …

Otce: A transferability metric for cross-domain cross-task representations

Y Tan, Y Li, SL Huang - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Transfer learning across heterogeneous data distributions (aka domains) and distinct tasks
is a more general and challenging problem than conventional transfer learning, where either …