RingMo: A remote sensing foundation model with masked image modeling

X Sun, P Wang, W Lu, Z Zhu, X Lu, Q He… - … on Geoscience and …, 2022 - ieeexplore.ieee.org
Deep learning approaches have contributed to the rapid development of remote sensing
(RS) image interpretation. The most widely used training paradigm is to use ImageNet …

An empirical study of remote sensing pretraining

D Wang, J Zhang, B Du, GS **a… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Deep learning has largely reshaped remote sensing (RS) research for aerial image
understanding and made a great success. Nevertheless, most of the existing deep models …

Lsknet: A foundation lightweight backbone for remote sensing

Y Li, X Li, Y Dai, Q Hou, L Liu, Y Liu, MM Cheng… - International Journal of …, 2024 - Springer
Remote sensing images pose distinct challenges for downstream tasks due to their inherent
complexity. While a considerable amount of research has been dedicated to remote sensing …

Applications of knowledge distillation in remote sensing: A survey

Y Himeur, N Aburaed, O Elharrouss, I Varlamis… - Information …, 2024 - Elsevier
With the ever-growing complexity of models in the field of remote sensing (RS), there is an
increasing demand for solutions that balance model accuracy with computational efficiency …

Siamohot: A lightweight dual siamese network for onboard hyperspectral object tracking via joint spatial-spectral knowledge distillation

C Sun, X Wang, Z Liu, Y Wan, L Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Hyperspectral object tracking is aimed at tracking targets by using both spatial information
and abundant spectral information, overcoming the drawbacks of traditional RGB tracking in …

MDNet: Mamba-effective diffusion-distillation network for RGB-thermal urban dense prediction

W Zhou, H Wu, Q Jiang - … on Circuits and Systems for Video …, 2024 - ieeexplore.ieee.org
In recent years, significant progress has been achieved in urban dense prediction tasks,
particularly with advancements in deep learning models and novel architectures that …

AST: Adaptive Self-supervised Transformer for optical remote sensing representation

Q He, X Sun, Z Yan, B Wang, Z Zhu, W Diao… - ISPRS Journal of …, 2023 - Elsevier
Due to the variation in spatial resolution and the diversity of object scales, the interpretation
of optical remote sensing images is extremely challenging. Deep learning has become the …

[HTML][HTML] Consecutive pre-training: A knowledge transfer learning strategy with relevant unlabeled data for remote sensing domain

T Zhang, P Gao, H Dong, Y Zhuang, G Wang… - Remote Sensing, 2022 - mdpi.com
Currently, under supervised learning, a model pre-trained by a large-scale nature scene
dataset and then fine-tuned on a few specific task labeling data is the paradigm that has …

EFCOMFF-Net: A multiscale feature fusion architecture with enhanced feature correlation for remote sensing image scene classification

J Chen, J Yi, A Chen, Z ** - IEEE Transactions on Geoscience …, 2023 - ieeexplore.ieee.org
Remote sensing images have the essential attribute of large-scale spatial variation and
complex scene information, as well as the high similarity between various classes and the …

Inherit with distillation and evolve with contrast: Exploring class incremental semantic segmentation without exemplar memory

D Zhao, B Yuan, Z Shi - IEEE Transactions on Pattern Analysis …, 2023 - ieeexplore.ieee.org
As a front-burner problem in incremental learning, class incremental semantic segmentation
(CISS) is plagued by catastrophic forgetting and semantic drift. Although recent methods …