A review of deep transfer learning and recent advancements

M Iman, HR Arabnia, K Rasheed - Technologies, 2023 - mdpi.com
Deep learning has been the answer to many machine learning problems during the past two
decades. However, it comes with two significant constraints: dependency on extensive …

Multimae: Multi-modal multi-task masked autoencoders

R Bachmann, D Mizrahi, A Atanov, A Zamir - European Conference on …, 2022 - Springer
We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders
(MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can …

Cat-seg: Cost aggregation for open-vocabulary semantic segmentation

S Cho, H Shin, S Hong, A Arnab… - Proceedings of the …, 2024 - openaccess.thecvf.com
Open-vocabulary semantic segmentation presents the challenge of labeling each pixel
within an image based on a wide range of text descriptions. In this work we introduce a …

When multitask learning meets partial supervision: A computer vision review

M Fontana, M Spratling, M Shi - Proceedings of the IEEE, 2024 - ieeexplore.ieee.org
Multitask learning (MTL) aims to learn multiple tasks simultaneously while exploiting their
mutual relationships. By using shared resources to simultaneously calculate multiple …

Exploring the limits of large scale pre-training

S Abnar, M Dehghani, B Neyshabur… - arxiv preprint arxiv …, 2021 - arxiv.org
Recent developments in large-scale machine learning suggest that by scaling up data,
model size and training time properly, one might observe that improvements in pre-training …

In silico proof of principle of machine learning-based antibody design at unconstrained scale

R Akbar, PA Robert, CR Weber, M Widrich, R Frank… - MAbs, 2022 - Taylor & Francis
Generative machine learning (ML) has been postulated to become a major driver in the
computational design of antigen-specific monoclonal antibodies (mAb). However, efforts to …

[HTML][HTML] Survey on deep learning based computer vision for sonar imagery

Y Steiniger, D Kraus, T Meisen - Engineering Applications of Artificial …, 2022 - Elsevier
Research on the automatic analysis of sonar images has focused on classical, ie non deep
learning based, approaches for a long time. Over the past 15 years, however, the application …

Transferability estimation using bhattacharyya class separability

M Pándy, A Agostinelli, J Uijlings… - Proceedings of the …, 2022 - openaccess.thecvf.com
Transfer learning has become a popular method for leveraging pre-trained models in
computer vision. However, without performing computationally expensive fine-tuning, it is …

Hyper-representations as generative models: Sampling unseen neural network weights

K Schürholt, B Knyazev… - Advances in Neural …, 2022 - proceedings.neurips.cc
Learning representations of neural network weights given a model zoo is an emerg-ing and
challenging area with many potential applications from model inspection, to neural …

Deep transfer learning for image classification: a survey

J Plested, T Gedeon - arxiv preprint arxiv:2205.09904, 2022 - arxiv.org
Deep neural networks such as convolutional neural networks (CNNs) and transformers have
achieved many successes in image classification in recent years. It has been consistently …