Deep learning-based multimodal emotion recognition from audio, visual, and text modalities: A systematic review of recent advancements and future prospects

S Zhang, Y Yang, C Chen, X Zhang, Q Leng… - Expert Systems with …, 2024‏ - Elsevier
Emotion recognition has recently attracted extensive interest due to its significant
applications to human–computer interaction. The expression of human emotion depends on …

Facial expression and body gesture emotion recognition: A systematic review on the use of visual data in affective computing

SC Leong, YM Tang, CH Lai, CKM Lee - Computer science review, 2023‏ - Elsevier
Emotion is an important driver of human decision-making and communication. With the
recent rise of human–computer interaction, affective computing has become a trending …

Multimodal emotion recognition with deep learning: advancements, challenges, and future directions

AV Geetha, T Mala, D Priyanka, E Uma - Information Fusion, 2024‏ - Elsevier
In recent years, affective computing has become a topic of considerable interest, driven by
its ability to enhance several domains, such as mental health monitoring, human–computer …

[HTML][HTML] An ongoing review of speech emotion recognition

J de Lope, M Graña - Neurocomputing, 2023‏ - Elsevier
User emotional status recognition is becoming a key feature in advanced Human Computer
Interfaces (HCI). A key source of emotional information is the spoken expression, which may …

Transformer-based multimodal feature enhancement networks for multimodal depression detection integrating video, audio and remote photoplethysmograph signals

H Fan, X Zhang, Y Xu, J Fang, S Zhang, X Zhao, J Yu - Information Fusion, 2024‏ - Elsevier
Depression stands as one of the most widespread psychological disorders and has
garnered increasing attention. Currently, how to effectively achieve automatic multimodal …

A review of multimodal emotion recognition from datasets, preprocessing, features, and fusion methods

B Pan, K Hirota, Z Jia, Y Dai - Neurocomputing, 2023‏ - Elsevier
Affective computing is one of the most important research fields in modern human–computer
interaction (HCI). The goal of affective computing is to study and develop the theories …

Multimodal emotion recognition using cross modal audio-video fusion with attention and deep metric learning

B Mocanu, R Tapu, T Zaharia - Image and Vision Computing, 2023‏ - Elsevier
In the last few years, the multi-modal emotion recognition has become an important research
issue in the affective computing community due to its wide range of applications that include …

Using transformers for multimodal emotion recognition: Taxonomies and state of the art review

S Hazmoune, F Bougamouza - Engineering Applications of Artificial …, 2024‏ - Elsevier
Emotion recognition is an aspect of human-computer interaction, affective computing, and
social robotics. Conventional unimodal approaches for emotion recognition, depending on …

An efficient feature selection method for arabic and english speech emotion recognition using Grey Wolf Optimizer

I Shahin, OA Alomari, AB Nassif, I Afyouni, IA Hashem… - Applied Acoustics, 2023‏ - Elsevier
Nowadays, analyzing and interpreting emotions through human speech communication
have drawn a great attention in the field of human-computer interaction. Therefore, many …

Multimodal emotion recognition based on facial expressions, speech, and EEG

J Pan, W Fang, Z Zhang, B Chen… - IEEE Open Journal of …, 2023‏ - ieeexplore.ieee.org
Goal: As an essential human-machine interactive task, emotion recognition has become an
emerging area over the decades. Although previous attempts to classify emotions have …