Deep model reassembly
In this paper, we explore a novel knowledge-transfer task, termed as Deep Model
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …
Breaking the data barrier: a review of deep learning techniques for democratizing AI with small datasets
IH Rather, S Kumar, AH Gandomi - Artificial Intelligence Review, 2024 - Springer
Justifiably, while big data is the primary interest of research and public discourse, it is
essential to acknowledge that small data remains prevalent. The same technological and …
essential to acknowledge that small data remains prevalent. The same technological and …
A survey on negative transfer
Transfer learning (TL) utilizes data or knowledge from one or more source domains to
facilitate learning in a target domain. It is particularly useful when the target domain has very …
facilitate learning in a target domain. It is particularly useful when the target domain has very …
How far pre-trained models are from neural collapse on the target dataset informs their transferability
This paper focuses on model transferability estimation, ie, assessing the performance of pre-
trained models on a downstream task without performing fine-tuning. Motivated by the …
trained models on a downstream task without performing fine-tuning. Motivated by the …
Leep: A new measure to evaluate transferability of learned representations
We introduce a new measure to evaluate the transferability of representations learned by
classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy …
classifiers. Our measure, the Log Expected Empirical Prediction (LEEP), is simple and easy …
Transferability estimation using bhattacharyya class separability
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …
computer vision. However, without performing computationally expensive fine-tuning, it is …
Sensitivity-aware visual parameter-efficient fine-tuning
Abstract Visual Parameter-Efficient Fine-Tuning (PEFT) has become a powerful alternative
for full fine-tuning so as to adapt pre-trained vision models to downstream tasks, which only …
for full fine-tuning so as to adapt pre-trained vision models to downstream tasks, which only …
CrowdTransfer: Enabling Crowd Knowledge Transfer in AIoT Community
Artificial Intelligence of Things (AIoT) is an emerging frontier based on the deep fusion of
Internet of Things (IoT) and Artificial Intelligence (AI) technologies. The fundamental goal of …
Internet of Things (IoT) and Artificial Intelligence (AI) technologies. The fundamental goal of …
Exploring model transferability through the lens of potential energy
Transfer learning has become crucial in computer vision tasks due to the vast availability of
pre-trained deep learning models. However, selecting the optimal pre-trained model from a …
pre-trained deep learning models. However, selecting the optimal pre-trained model from a …
Otce: A transferability metric for cross-domain cross-task representations
Transfer learning across heterogeneous data distributions (aka domains) and distinct tasks
is a more general and challenging problem than conventional transfer learning, where either …
is a more general and challenging problem than conventional transfer learning, where either …