Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

A Gandhi, K Adhvaryu, S Poria, E Cambria, A Hussain - Information Fusion, 2023 - Elsevier
Sentiment analysis (SA) has gained much traction In the field of artificial intelligence (AI) and
natural language processing (NLP). There is growing demand to automate analysis of user …

Multimodal video sentiment analysis using deep learning approaches, a survey

SA Abdu, AH Yousef, A Salem - Information Fusion, 2021 - Elsevier
Deep learning has emerged as a powerful machine learning technique to employ in
multimodal sentiment analysis tasks. In the recent years, many deep learning models and …

Multimodal sentiment analysis based on fusion methods: A survey

L Zhu, Z Zhu, C Zhang, Y Xu, X Kong - Information Fusion, 2023 - Elsevier
Sentiment analysis is an emerging technology that aims to explore people's attitudes toward
an entity. It can be applied in a variety of different fields and scenarios, such as product …

A comprehensive survey on multi-modal conversational emotion recognition with deep learning

Y Shou, T Meng, W Ai, N Yin, K Li - arxiv preprint arxiv:2312.05735, 2023 - arxiv.org
Multi-modal conversation emotion recognition (MCER) aims to recognize and track the
speaker's emotional state using text, speech, and visual information in the conversation …

Progress, achievements, and challenges in multimodal sentiment analysis using deep learning: A survey

A Pandey, DK Vishwakarma - Applied Soft Computing, 2024 - Elsevier
Sentiment analysis is a computational technique that analyses the subjective information
conveyed within a given expression. This encompasses appraisals, opinions, attitudes or …

Multimodal human-agent dialogue corpus with annotations at utterance and dialogue levels

K Komatani, S Okada - 2021 9th International Conference on …, 2021 - ieeexplore.ieee.org
The behaviors of general users for a dialogue system differ greatly from those for a human
interlocutor. We have been collecting a multimodal dialogue corpus between a human …

Multimodality for NLP-centered applications: Resources, advances and frontiers

M Garg, S Wazarkar, M Singh… - Proceedings of the …, 2022 - aclanthology.org
With the development of multimodal systems and natural language generation techniques,
the resurgence of multimodal datasets has attracted significant research interests, which …

Sentiment analysis of social media comments based on multimodal attention fusion network

Z Liu, T Yang, W Chen, J Chen, Q Li, J Zhang - Applied Soft Computing, 2024 - Elsevier
Social media comments are no longer in a single textual modality, but heterogeneous data
in multiple modalities, such as vision, sound, and text, which is why multimodal sentiment …

CLGSI: a multimodal sentiment analysis framework based on contrastive learning guided by sentiment intensity

Y Yang, X Dong, Y Qiang - Findings of the Association for …, 2024 - aclanthology.org
Recently, contrastive learning has begun to gain popularity in multimodal sentiment analysis
(MSA). However, most of existing MSA methods based on contrastive learning lacks more …

A Comprehensive Survey on Deep Learning Multi-Modal Fusion: Methods, Technologies and Applications.

T Jiao, C Guo, X Feng, Y Chen… - Computers, Materials & …, 2024 - search.ebscohost.com
Multi-modal fusion technology gradually become a fundamental task in many fields, such as
autonomous driving, smart healthcare, sentiment analysis, and human-computer interaction …