CFCNN: A novel convolutional fusion framework for collaborative fault identification of rotating machinery

Y Xu, K Feng, X Yan, R Yan, Q Ni, B Sun, Z Lei… - Information …, 2023 - Elsevier
Sensor techniques and emerging CNN models have greatly facilitated the development of
collaborative fault diagnosis. Existing CNN models apply different fusion schemes to …

From knowledge distillation to self-knowledge distillation: A unified approach with normalized loss and customized soft labels

Z Yang, A Zeng, Z Li, T Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Knowledge Distillation (KD) uses the teacher's prediction logits as soft labels to
guide the student, while self-KD does not need a real teacher to require the soft labels. This …

Representation compensation networks for continual semantic segmentation

CB Zhang, JW **ao, X Liu, YC Chen… - Proceedings of the …, 2022 - openaccess.thecvf.com
In this work, we study the continual semantic segmentation problem, where the deep neural
networks are required to incorporate new classes continually without catastrophic forgetting …

Self-distillation from the last mini-batch for consistency regularization

Y Shen, L Xu, Y Yang, Y Li… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Abstract Knowledge distillation (KD) shows a bright promise as a powerful regularization
strategy to boost generalization ability by leveraging learned sample-level soft targets. Yet …

Learning representations for image-based profiling of perturbations

N Moshkov, M Bornholdt, S Benoit, M Smith… - Nature …, 2024 - nature.com
Measuring the phenotypic effect of treatments on cells through imaging assays is an efficient
and powerful way of studying cell biology, and requires computational methods for …

Cross-modal fusion convolutional neural networks with online soft-label training strategy for mechanical fault diagnosis

Y Xu, K Feng, X Yan, X Sheng, B Sun… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Convolutional neural network (CNN)-based fault detection approaches based on
multisource signals have attracted increasing interest from the research community and …

Eliciting and learning with soft labels from every annotator

KM Collins, U Bhatt, A Weller - Proceedings of the AAAI conference on …, 2022 - ojs.aaai.org
The labels used to train machine learning (ML) models are of paramount importance.
Typically for ML classification tasks, datasets contain hard labels, yet learning using soft …

Zlpr: A novel loss for multi-label classification

J Su, M Zhu, A Murtadha, S Pan, B Wen… - arxiv preprint arxiv …, 2022 - arxiv.org
In the era of deep learning, loss functions determine the range of tasks available to models
and algorithms. To support the application of deep learning in multi-label classification …

Separating noisy samples from tail classes for long-tailed image classification with label noise

C Fang, L Cheng, Y Mao, D Zhang… - … on Neural Networks …, 2023 - ieeexplore.ieee.org
Most existing methods that cope with noisy labels usually assume that the classwise data
distributions are well balanced. They are difficult to deal with the practical scenarios where …

An efficient CNN-LSTM network with spectral normalization and label smoothing technologies for SSVEP frequency recognition

Y Pan, J Chen, Y Zhang, Y Zhang - Journal of neural …, 2022 - iopscience.iop.org
Objective. Steady-state visual evoked potentials (SSVEPs) based brain–computer interface
(BCI) has received great interests owing to the high information transfer rate and available …