Attention-guided feature distillation for semantic segmentation

AM Mansourian, A Jalali, R Ahmadi… - arxiv preprint arxiv …, 2024 - arxiv.org
In contrast to existing complex methodologies commonly employed for distilling knowledge
from a teacher to a student, this paper showcases the efficacy of a simple yet powerful …

YOLOv7-KDT: An ensemble model for pomelo counting in complex environment

W Yi, S **a, S Kuzmin, I Gerasimov, X Cheng - Computers and Electronics …, 2024 - Elsevier
Pomelo counting recognition in complex environments faces many difficulties, mainly
including changes in illumination, occlusion, and complex backgrounds. These factors …

Boundary and relation distillation for semantic segmentation

D Zhang, P Dong, X Hu, L Chen, KT Cheng - arxiv preprint arxiv …, 2024 - arxiv.org
Recently, it has been revealed that small semantic segmentation (SS) models exhibit a
tendency to make errors in maintaining boundary region completeness and preserving …

DFD: distilling the feature disparity differently for detectors

K Liu, Y Zhang, J Zhang, J Li, J Wang… - … on Machine Learning, 2024 - openreview.net
Knowledge distillation is a widely adopted model compression technique that has been
successfully applied to object detection. In feature distillation, it is common practice for the …

[HTML][HTML] Precision and Efficiency in Dam Crack Inspection: A Lightweight Object Detection Method Based on Joint Distillation for Unmanned Aerial Vehicles (UAVs)

H Dong, N Wang, D Fu, F Wei, G Liu, B Liu - Drones, 2024 - mdpi.com
Dams in their natural environment will gradually develop cracks and other forms of damage.
If not detected and repaired in time, the structural strength of the dam may be reduced, and it …

Positive Anchor Area Merge Algorithm: A Knowledge Distillation Algorithm for Fruit Detection Tasks Based on Yolov8

X Shi, X Zhang, Y Su, X Zhang - IEEE Access, 2025 - ieeexplore.ieee.org
The existing YOLOv8 framework has achieved great success in the field of object detection.
However, in some specific recognition tasks, for example, counting the number of fruit in a …

[PDF][PDF] Efficacy of Foundation-Model-Based Distillation for Image Classification

SI Shakir - 2024 - publica.fraunhofer.de
In this work, we explore the efficacy of knowledge distillation in the field of computer vision
classification tasks. We focus on the distillation of a large foundation teacher model to a less …