Deep model reassembly

X Yang, D Zhou, S Liu, J Ye… - Advances in neural …, 2022 - proceedings.neurips.cc
In this paper, we explore a novel knowledge-transfer task, termed as Deep Model
Reassembly (DeRy), for general-purpose model reuse. Given a collection of heterogeneous …

Federated learning from pre-trained models: A contrastive learning approach

Y Tan, G Long, J Ma, L Liu, T Zhou… - Advances in neural …, 2022 - proceedings.neurips.cc
Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to
learn collaboratively without sharing their private data. However, excessive computation and …

Transfer learning for radio frequency machine learning: a taxonomy and survey

LJ Wong, AJ Michaels - Sensors, 2022 - mdpi.com
Transfer learning is a pervasive technology in computer vision and natural language
processing fields, yielding exponential performance improvements by leveraging prior …

Sepico: Semantic-guided pixel contrast for domain adaptive semantic segmentation

B **e, S Li, M Li, CH Liu, G Huang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Domain adaptive semantic segmentation attempts to make satisfactory dense predictions on
an unlabeled target domain by utilizing the supervised model trained on a labeled source …

Reusing deep learning models: Challenges and directions in software engineering

JC Davis, P Jajal, W Jiang… - 2023 IEEE John …, 2023 - ieeexplore.ieee.org
Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including
computer vision, system configuration, and question-answering. However, DNNs are …

A survey on negative transfer

W Zhang, L Deng, L Zhang, D Wu - IEEE/CAA Journal of …, 2022 - ieeexplore.ieee.org
Transfer learning (TL) utilizes data or knowledge from one or more source domains to
facilitate learning in a target domain. It is particularly useful when the target domain has very …

Transferability in deep learning: A survey

J Jiang, Y Shu, J Wang, M Long - arxiv preprint arxiv:2201.05867, 2022 - arxiv.org
The success of deep learning algorithms generally depends on large-scale data, while
humans appear to have inherent ability of knowledge transfer, by recognizing and applying …

How far pre-trained models are from neural collapse on the target dataset informs their transferability

Z Wang, Y Luo, L Zheng, Z Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper focuses on model transferability estimation, ie, assessing the performance of pre-
trained models on a downstream task without performing fine-tuning. Motivated by the …

A broad study of pre-training for domain generalization and adaptation

D Kim, K Wang, S Sclaroff, K Saenko - European Conference on Computer …, 2022 - Springer
Deep models must learn robust and transferable representations in order to perform well on
new domains. While domain transfer methods (eg, domain adaptation, domain …

Transferability estimation using bhattacharyya class separability

M Pándy, A Agostinelli, J Uijlings… - Proceedings of the …, 2022 - openaccess.thecvf.com
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …