Facial emotion recognition: State of the art performance on FER2013

Y Khaireddin, Z Chen - arxiv preprint arxiv:2105.03588, 2021 - arxiv.org
Facial emotion recognition (FER) is significant for human-computer interaction such as
clinical practice and behavioral description. Accurate and robust FER by computer models …

Weight-sharing neural architecture search: A battle to shrink the optimization gap

L **e, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Analyzing and improving the training dynamics of diffusion models

T Karras, M Aittala, J Lehtinen… - Proceedings of the …, 2024 - openaccess.thecvf.com
Diffusion models currently dominate the field of data-driven image synthesis with their
unparalleled scaling to large datasets. In this paper we identify and rectify several causes for …

Learn from all: Erasing attention consistency for noisy label facial expression recognition

Y Zhang, C Wang, X Ling, W Deng - European Conference on Computer …, 2022 - Springer
Abstract Noisy label Facial Expression Recognition (FER) is more challenging than
traditional noisy label classification tasks due to the inter-class similarity and the annotation …

Big transfer (bit): General visual representation learning

A Kolesnikov, L Beyer, X Zhai, J Puigcerver… - Computer Vision–ECCV …, 2020 - Springer
Transfer of pre-trained representations improves sample efficiency and simplifies
hyperparameter tuning when training deep neural networks for vision. We revisit the …

Group knowledge transfer: Federated learning of large cnns at the edge

C He, M Annavaram… - Advances in Neural …, 2020 - proceedings.neurips.cc
Scaling up the convolutional neural network (CNN) size (eg, width, depth, etc.) is known to
effectively improve model accuracy. However, the large model size impedes training on …

Relative uncertainty learning for facial expression recognition

Y Zhang, C Wang, W Deng - Advances in Neural …, 2021 - proceedings.neurips.cc
In facial expression recognition (FER), the uncertainties introduced by inherent noises like
ambiguous facial expressions and inconsistent labels raise concerns about the credibility of …

Linear mode connectivity and the lottery ticket hypothesis

J Frankle, GK Dziugaite, D Roy… - … on Machine Learning, 2020 - proceedings.mlr.press
We study whether a neural network optimizes to the same, linearly connected minimum
under different samples of SGD noise (eg, random data order and augmentation). We find …

Gradient descent on neural networks typically occurs at the edge of stability

JM Cohen, S Kaur, Y Li, JZ Kolter… - arxiv preprint arxiv …, 2021 - arxiv.org
We empirically demonstrate that full-batch gradient descent on neural network training
objectives typically operates in a regime we call the Edge of Stability. In this regime, the …

Understanding the generalization benefit of normalization layers: Sharpness reduction

K Lyu, Z Li, S Arora - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Abstract Normalization layers (eg, Batch Normalization, Layer Normalization) were
introduced to help with optimization difficulties in very deep nets, but they clearly also help …