Leveraging recent advances in deep learning for audio-visual emotion recognition

L Schoneveld, A Othmani, H Abdelkawy - Pattern Recognition Letters, 2021‏ - Elsevier
Emotional expressions are the behaviors that communicate our emotional state or attitude to
others. They are expressed through verbal and non-verbal communication. Complex human …

A survey of sentiment analysis in social media

L Yue, W Chen, X Li, W Zuo, M Yin - Knowledge and Information Systems, 2019‏ - Springer
Sentiments or opinions from social media provide the most up-to-date and inclusive
information, due to the proliferation of social media and the low barrier for posting the …

MMGCN: Multi-modal graph convolution network for personalized recommendation of micro-video

Y Wei, X Wang, L Nie, X He, R Hong… - Proceedings of the 27th …, 2019‏ - dl.acm.org
Personalized recommendation plays a central role in many online content sharing platforms.
To provide quality micro-video recommendation service, it is of crucial importance to …

Multimodal machine learning: A survey and taxonomy

T Baltrušaitis, C Ahuja… - IEEE transactions on …, 2018‏ - ieeexplore.ieee.org
Our experience of the world is multimodal-we see objects, hear sounds, feel texture, smell
odors, and taste flavors. Modality refers to the way in which something happens or is …

A review of affective computing: From unimodal analysis to multimodal fusion

S Poria, E Cambria, R Bajpai, A Hussain - Information fusion, 2017‏ - Elsevier
Affective computing is an emerging interdisciplinary research field bringing together
researchers and practitioners from various fields, ranging from artificial intelligence, natural …

Fusing pairwise modalities for emotion recognition in conversations

C Fan, J Lin, R Mao, E Cambria - Information Fusion, 2024‏ - Elsevier
Multimodal fusion has the potential to significantly enhance model performance in the
domain of Emotion Recognition in Conversations (ERC) by efficiently integrating information …

Openface: an open source facial behavior analysis toolkit

T Baltrušaitis, P Robinson… - 2016 IEEE winter …, 2016‏ - ieeexplore.ieee.org
Over the past few years, there has been an increased interest in automatic facial behavior
analysis and understanding. We present OpenFace-an open source tool intended for …

Sewa db: A rich database for audio-visual emotion and sentiment research in the wild

J Kossaifi, R Walecki, Y Panagakis… - IEEE transactions on …, 2019‏ - ieeexplore.ieee.org
Natural human-computer interaction and audio-visual human behaviour sensing systems,
which would achieve robust performance in-the-wild are more needed than ever as digital …

Analysis of EEG signals and facial expressions for continuous emotion detection

M Soleymani, S Asghari-Esfeden, Y Fu… - IEEE Transactions on …, 2015‏ - ieeexplore.ieee.org
Emotions are time varying affective phenomena that are elicited as a result of stimuli. Videos
and movies in particular are made to elicit emotions in their audiences. Detecting the …

A review and meta-analysis of multimodal affect detection systems

SK D'mello, J Kory - ACM computing surveys (CSUR), 2015‏ - dl.acm.org
Affect detection is an important pattern recognition problem that has inspired researchers
from several areas. The field is in need of a systematic review due to the recent influx of …