Transformer-based multimodal emotional perception for dynamic facial expression recognition in the wild

X Zhang, M Li, S Lin, H Xu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Dynamic expression recognition in the wild is a challenging task due to various obstacles,
including low light condition, non-positive face, and face occlusion. Purely vision-based …

Recursive joint cross-modal attention for multimodal fusion in dimensional emotion recognition

RG Praveen, J Alam - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Though multimodal emotion recognition has achieved significant progress over recent years
the potential of rich synergic relationships across the modalities is not fully exploited. In this …

Privileged knowledge distillation for dimensional emotion recognition in the wild

MH Aslam, MO Zeeshan, M Pedersoli… - Proceedings of the …, 2023 - openaccess.thecvf.com
Automated emotion recognition (AER) has a growing number of applications, ranging from
behavior analysis in assistive robotics and smart e-learning to depression or pain detection …

Enhanced multimodal emotion recognition in healthcare analytics: A deep learning based model-level fusion approach

MM Islam, S Nooruddin, F Karray… - … Signal Processing and …, 2024 - Elsevier
Deep learning techniques have drawn considerable interest in emotion recognition due to
recent technological developments in healthcare analytics. Automatic patient emotion …

Affective behaviour analysis via integrating multi-modal knowledge

W Zhang, F Qiu, C Liu, L Li, H Du, T Guo… - arxiv preprint arxiv …, 2024 - arxiv.org
Affective Behavior Analysis aims to facilitate technology emotionally smart, creating a world
where devices can understand and react to our emotions as humans do. To …

An Effective Ensemble Learning Framework for Affective Behaviour Analysis

W Zhang, F Qiu, C Liu, L Li, H Du… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Affective Behavior Analysis aims to facilitate technology emotionally smart creating
a world where devices can understand and react to our emotions as humans do. To …

Recursive joint attention for audio-visual fusion in regression based emotion recognition

RG Praveen, E Granger… - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
In video-based emotion recognition (ER), it is important to effectively leverage the
complementary relationship among audio (A) and visual (V) modalities, while retaining the …

Distilling privileged multimodal information for expression recognition using optimal transport

MH Aslam, MO Zeeshan, S Belharbi… - 2024 IEEE 18th …, 2024 - ieeexplore.ieee.org
Deep learning models for multimodal expression recognition have reached remarkable
performance in controlled laboratory environments because of their ability to learn …

Audio-visual person verification based on recursive fusion of joint cross-attention

RG Praveen, J Alam - 2024 IEEE 18th International Conference …, 2024 - ieeexplore.ieee.org
Person or identity verification has been recently gaining a lot of attention using audio-visual
fusion as faces and voices share close associations with each other. Conventional …

Incongruity-aware cross-modal attention for audio-visual fusion in dimensional emotion recognition

RG Praveen, J Alam - IEEE Journal of Selected Topics in Signal …, 2024 - ieeexplore.ieee.org
Multimodal emotion recognition has immense potential for the comprehensive assessment
of human emotions, utilizing multiple modalities that often exhibit complementary …