Visual tuning
Fine-tuning visual models has been widely shown promising performance on many
downstream visual tasks. With the surprising development of pre-trained visual foundation …
downstream visual tasks. With the surprising development of pre-trained visual foundation …
Ranpac: Random projections and pre-trained models for continual learning
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …
Heterogeneous lora for federated fine-tuning of on-device foundation models
Foundation models (FMs) adapt surprisingly well to downstream tasks with fine-tuning.
However, their colossal parameter space prohibits their training on resource-constrained …
However, their colossal parameter space prohibits their training on resource-constrained …
A closer look at few-shot classification again
Few-shot classification consists of a training phase where a model is learned on a relatively
large dataset and an adaptation phase where the learned model is adapted to previously …
large dataset and an adaptation phase where the learned model is adapted to previously …
Efficient model personalization in federated learning via client-specific prompt generation
Federated learning (FL) emerges as a decentralized learning framework which trains
models from multiple distributed clients without sharing their data to preserve privacy …
models from multiple distributed clients without sharing their data to preserve privacy …
First session adaptation: A strong replay-free baseline for class-incremental learning
A Panos, Y Kobe, DO Reino… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract In Class-Incremental Learning (CIL) an image classification system is exposed to
new classes in each learning session and must be updated incrementally. Methods …
new classes in each learning session and must be updated incrementally. Methods …
Guiding the last layer in federated learning with pre-trained models
Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a
number of participants without sharing data. Recent works have begun to consider the …
number of participants without sharing data. Recent works have begun to consider the …
PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees
Abstract Personalized Federated Learning (pFL) has emerged as a promising solution to
tackle data heterogeneity across clients in FL. However existing pFL methods either (1) …
tackle data heterogeneity across clients in FL. However existing pFL methods either (1) …
Toward green and human-like artificial intelligence: A complete survey on contemporary few-shot learning approaches
Despite deep learning's widespread success, its data-hungry and computationally
expensive nature makes it impractical for many data-constrained real-world applications …
expensive nature makes it impractical for many data-constrained real-world applications …
On the efficacy of differentially private few-shot image classification
There has been significant recent progress in training differentially private (DP) models
which achieve accuracy that approaches the best non-private models. These DP models are …
which achieve accuracy that approaches the best non-private models. These DP models are …