Deep model reassembly
In this paper, we explore a novel knowledge-transfer task, termed as Deep Model
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …
Federated learning from pre-trained models: A contrastive learning approach
Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to
learn collaboratively without sharing their private data. However, excessive computation and …
learn collaboratively without sharing their private data. However, excessive computation and …
Transfer learning for radio frequency machine learning: a taxonomy and survey
Transfer learning is a pervasive technology in computer vision and natural language
processing fields, yielding exponential performance improvements by leveraging prior …
processing fields, yielding exponential performance improvements by leveraging prior …
Sepico: Semantic-guided pixel contrast for domain adaptive semantic segmentation
Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on
an unlabeled target domain by utilizing the supervised model trained on a labeled source …
an unlabeled target domain by utilizing the supervised model trained on a labeled source …
Reusing deep learning models: Challenges and directions in software engineering
Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including
computer vision, system configuration, and question-answering. However, DNNs are …
computer vision, system configuration, and question-answering. However, DNNs are …
A survey on negative transfer
Transfer learning (TL) utilizes data or knowledge from one or more source domains to
facilitate learning in a target domain. It is particularly useful when the target domain has very …
facilitate learning in a target domain. It is particularly useful when the target domain has very …
Transferability in deep learning: A survey
The success of deep learning algorithms generally depends on large-scale data, while
humans appear to have inherent ability of knowledge transfer, by recognizing and applying …
humans appear to have inherent ability of knowledge transfer, by recognizing and applying …
How far pre-trained models are from neural collapse on the target dataset informs their transferability
This paper focuses on model transferability estimation, ie, assessing the performance of pre-
trained models on a downstream task without performing fine-tuning. Motivated by the …
trained models on a downstream task without performing fine-tuning. Motivated by the …
A broad study of pre-training for domain generalization and adaptation
Deep models must learn robust and transferable representations in order to perform well on
new domains. While domain transfer methods (eg, domain adaptation, domain …
new domains. While domain transfer methods (eg, domain adaptation, domain …
Transferability estimation using bhattacharyya class separability
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …
computer vision. However, without performing computationally expensive fine-tuning, it is …