Supervised masked knowledge distillation for few-shot transformers

H Lin, G Han, J Ma, S Huang, X Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Vision Transformers (ViTs) emerge to achieve impressive performance on many
data-abundant computer vision tasks by capturing long-range dependencies among local …

Class-aware patch embedding adaptation for few-shot image classification

F Hao, F He, L Liu, F Wu, D Tao… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract" A picture is worth a thousand words", significantly beyond mere a categorization.
Accompanied by that, many patches of the image could have completely irrelevant …

Rethinking generalization in few-shot classification

M Hiller, R Ma, M Harandi… - Advances in Neural …, 2022 - proceedings.neurips.cc
Single image-level annotations only correctly describe an often small subset of an image's
content, particularly when complex real-world scenes are depicted. While this might be …

Easy—ensemble augmented-shot-y-shaped learning: State-of-the-art few-shot classification with simple components

Y Bendou, Y Hu, R Lafargue, G Lioi, B Pasdeloup… - Journal of …, 2022 - mdpi.com
Few-shot classification aims at leveraging knowledge learned in a deep learning model, in
order to obtain good classification performance on new problems, where only a few labeled …

Self-regularized prototypical network for few-shot semantic segmentation

H Ding, H Zhang, X Jiang - Pattern Recognition, 2023 - Elsevier
The deep CNNs in image semantic segmentation typically require a large number of
densely-annotated images for training and have difficulties in generalizing to unseen object …

Attribute surrogates learning and spectral tokens pooling in transformers for few-shot learning

Y He, W Liang, D Zhao, HY Zhou… - Proceedings of the …, 2022 - openaccess.thecvf.com
This paper presents new hierarchically cascaded transformers that can improve data
efficiency through attribute surrogates learning and spectral tokens pooling. Vision …

Label-guided knowledge distillation for continual semantic segmentation on 2d images and 3d point clouds

Z Yang, R Li, E Ling, C Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual semantic segmentation (CSS) aims to extend an existing model to tackle unseen
tasks while retaining its old knowledge. Naively fine-tuning the old model on new data leads …