A survey of speech emotion recognition in natural environment

MS Fahad, A Ranjan, J Yadav, A Deepak - Digital signal processing, 2021 - Elsevier
While speech emotion recognition (SER) has been an active research field since the last
three decades, the techniques that deal with the natural environment have only emerged in …

Sentiment analysis: Comprehensive reviews, recent advances, and open challenges

Q Lu, X Sun, Y Long, Z Gao, J Feng… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Sentiment analysis (SA) aims to understand the attitudes and views of opinion holders with
computers. Previous studies have achieved significant breakthroughs and extensive …

Missing modality imagination network for emotion recognition with uncertain missing modalities

J Zhao, R Li, Q ** - Proceedings of the 59th Annual Meeting of …, 2021 - aclanthology.org
Multimodal fusion has been proved to improve emotion recognition performance in previous
works. However, in real-world applications, we often encounter the problem of missing …

CTNet: Conversational transformer network for emotion recognition

Z Lian, B Liu, J Tao - IEEE/ACM Transactions on Audio, Speech …, 2021 - ieeexplore.ieee.org
Emotion recognition in conversation is a crucial topic for its widespread applications in the
field of human-computer interactions. Unlike vanilla emotion recognition of individual …

Learning audio-video modalities from image captions

A Nagrani, PH Seo, B Seybold, A Hauth… - … on Computer Vision, 2022 - Springer
There has been a recent explosion of large-scale image-text datasets, as images with alt-
text captions can be easily obtained online. Obtaining large-scale, high quality data for video …

PriMonitor: an adaptive tuning privacy-preserving approach for multimodal emotion detection

L Yin, S Lin, Z Sun, S Wang, R Li, Y He - World Wide Web, 2024 - Springer
The proliferation of edge computing and the Internet of Vehicles (IoV) has significantly
bolstered the popularity of deep learning-based driver assistance applications. This has …

Inconsistent matters: A knowledge-guided dual-consistency network for multi-modal rumor detection

M Sun, X Zhang, J Ma, S **e, Y Liu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Rumor spreaders are increasingly utilizing multimedia content to attract the attention and
trust of news consumers. Though quite a few rumor detection models have exploited the …

Multimodal emotion recognition with temporal and semantic consistency

B Chen, Q Cao, M Hou, Z Zhang, G Lu… - … /ACM Transactions on …, 2021 - ieeexplore.ieee.org
Automated multimodal emotion recognition has become an emerging but challenging
research topic in the fields of affective learning and sentiment analysis. The existing works …

C-GCN: Correlation based graph convolutional network for audio-video emotion recognition

W Nie, M Ren, J Nie, S Zhao - IEEE Transactions on Multimedia, 2020 - ieeexplore.ieee.org
With the development of both hardware and deep neural network technologies, tremendous
improvements have been achieved in the performance of automatic emotion recognition …

Group gated fusion on attention-based bidirectional alignment for multimodal emotion recognition

P Liu, K Li, H Meng - arxiv preprint arxiv:2201.06309, 2022 - arxiv.org
Emotion recognition is a challenging and actively-studied research area that plays a critical
role in emotion-aware human-computer interaction systems. In a multimodal setting …