Visual tuning

BXB Yu, J Chang, H Wang, L Liu, S Wang… - ACM Computing …, 2024 - dl.acm.org
Fine-tuning visual models has been widely shown promising performance on many
downstream visual tasks. With the surprising development of pre-trained visual foundation …

Ranpac: Random projections and pre-trained models for continual learning

MD McDonnell, D Gong, A Parvaneh… - Advances in …, 2024 - proceedings.neurips.cc
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …

Heterogeneous lora for federated fine-tuning of on-device foundation models

YJ Cho, L Liu, Z Xu, A Fahrezi… - Proceedings of the 2024 …, 2024 - aclanthology.org
Foundation models (FMs) adapt surprisingly well to downstream tasks with fine-tuning.
However, their colossal parameter space prohibits their training on resource-constrained …

A closer look at few-shot classification again

X Luo, H Wu, J Zhang, L Gao, J Xu… - … on Machine Learning, 2023 - proceedings.mlr.press
Few-shot classification consists of a training phase where a model is learned on a relatively
large dataset and an adaptation phase where the learned model is adapted to previously …

Efficient model personalization in federated learning via client-specific prompt generation

FE Yang, CY Wang, YCF Wang - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Federated learning (FL) emerges as a decentralized learning framework which trains
models from multiple distributed clients without sharing their data to preserve privacy …

First session adaptation: A strong replay-free baseline for class-incremental learning

A Panos, Y Kobe, DO Reino… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract In Class-Incremental Learning (CIL) an image classification system is exposed to
new classes in each learning session and must be updated incrementally. Methods …

Guiding the last layer in federated learning with pre-trained models

G Legate, N Bernier, L Page-Caccia… - Advances in …, 2023 - proceedings.neurips.cc
Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a
number of participants without sharing data. Recent works have begun to consider the …

PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees

C **e, DA Huang, W Chu, D Xu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Personalized Federated Learning (pFL) has emerged as a promising solution to
tackle data heterogeneity across clients in FL. However existing pFL methods either (1) …

Toward green and human-like artificial intelligence: A complete survey on contemporary few-shot learning approaches

G Tsoumplekas, V Li, V Argyriou, A Lytos… - arxiv preprint arxiv …, 2024 - arxiv.org
Despite deep learning's widespread success, its data-hungry and computationally
expensive nature makes it impractical for many data-constrained real-world applications …

On the efficacy of differentially private few-shot image classification

M Tobaben, A Shysheya, J Bronskill, A Paverd… - arxiv preprint arxiv …, 2023 - arxiv.org
There has been significant recent progress in training differentially private (DP) models
which achieve accuracy that approaches the best non-private models. These DP models are …