A review of multimodal emotion recognition from datasets, preprocessing, features, and fusion methods

B Pan, K Hirota, Z Jia, Y Dai - Neurocomputing, 2023 - Elsevier
Affective computing is one of the most important research fields in modern human–computer
interaction (HCI). The goal of affective computing is to study and develop the theories …

[HTML][HTML] New trends in emotion recognition using image analysis by neural networks, a systematic review

AL Cîrneanu, D Popescu, D Iordache - Sensors, 2023 - mdpi.com
Facial emotion recognition (FER) is a computer vision process aimed at detecting and
classifying human emotional expressions. FER systems are currently used in a vast range of …

Classifying emotions and engagement in online learning based on a single facial expression recognition neural network

AV Savchenko, LV Savchenko… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
In this article, behaviour of students in the e-learning environment is analyzed. The novel
pipeline is proposed based on video facial processing. At first, face detection, tracking and …

Benchmarking micro-action recognition: Dataset, methods, and applications

D Guo, K Li, B Hu, Y Zhang… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Micro-action is an imperceptible non-verbal behaviour characterised by low-intensity
movement. It offers insights into the feelings and intentions of individuals and is important for …

Dive into ambiguity: Latent distribution mining and pairwise uncertainty estimation for facial expression recognition

J She, Y Hu, H Shi, J Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Due to the subjective annotation and the inherent inter-class similarity of facial expressions,
one of key challenges in Facial Expression Recognition (FER) is the annotation ambiguity …

Eamm: One-shot emotional talking face via audio-based emotion-aware motion model

X Ji, H Zhou, K Wang, Q Wu, W Wu, F Xu… - ACM SIGGRAPH 2022 …, 2022 - dl.acm.org
Although significant progress has been made to audio-driven talking face generation,
existing methods either neglect facial emotion or cannot be applied to arbitrary subjects. In …

Efficient emotional adaptation for audio-driven talking-head generation

Y Gan, Z Yang, X Yue, L Sun… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Audio-driven talking-head synthesis is a popular research topic for virtual human-related
applications. However, the inflexibility and inefficiency of existing methods, which …

Region attention networks for pose and occlusion robust facial expression recognition

K Wang, X Peng, J Yang, D Meng… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Occlusion and pose variations, which can change facial appearance significantly, are two
major obstacles for automatic Facial Expression Recognition (FER). Though automatic FER …

Ferv39k: A large-scale multi-scene dataset for facial expression recognition in videos

Y Wang, Y Sun, Y Huang, Z Liu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Current benchmarks for facial expression recognition (FER) mainly focus on static images,
while there are limited datasets for FER in videos. It is still ambiguous to evaluate whether …

Facial expression and attributes recognition based on multi-task learning of lightweight neural networks

AV Savchenko - 2021 IEEE 19th international symposium on …, 2021 - ieeexplore.ieee.org
In this paper, the multi-task learning of lightweight convolutional neural networks is studied
for face identification and classification of facial attributes (age, gender, ethnicity) trained on …