Revisiting multimodal emotion recognition in conversation from the perspective of graph spectrum

T Meng, F Zhang, Y Shou, W Ai, N Yin, K Li - arxiv preprint arxiv …, 2024 - arxiv.org
Efficiently capturing consistent and complementary semantic features in a multimodal
conversation context is crucial for Multimodal Emotion Recognition in Conversation (MERC) …

Deep modular co-attention shifting network for multimodal sentiment analysis

P Shi, M Hu, X Shi, F Ren - ACM Transactions on Multimedia Computing …, 2024 - dl.acm.org
Human Multimodal Sentiment Analysis (MSA) is an attractive research that studies sentiment
expressed from multiple heterogeneous modalities. While transformer-based methods have …

Sia-net: Sparse interactive attention network for multimodal emotion recognition

S Li, T Zhang, CLP Chen - IEEE Transactions on Computational …, 2024 - ieeexplore.ieee.org
Multimodal emotion recognition (MER) integrates multiple modalities to identify the user's
emotional state, which is the core technology of natural and friendly human–computer …

Multimodal Sentiment Analysis of Government Information Comments Based on Contrastive Learning and Cross-Attention Fusion Networks

G Mu, C Chen, X Li, J Li, X Ju, J Dai - IEEE Access, 2024 - ieeexplore.ieee.org
Accurate identification of sentiments in government-related comments is crucial for
policymakers to deeply understand public opinion, adjust policies promptly, and enhance …

CCDA: A novel method to explore the cross-correlation in dual-attention for multimodal sentiment analysis

P Wang, S Liu, J Chen - Applied Sciences, 2024 - mdpi.com
With the development of the Internet, the content that people share contains types of text,
images, and videos, and utilizing these multimodal data for sentiment analysis has become …

Dynamic weighted multitask learning and contrastive learning for multimodal sentiment analysis

X Wang, M Zhang, B Chen, D Wei, Y Shao - Electronics, 2023 - mdpi.com
Multimodal sentiment analysis (MSA) has attracted more and more attention in recent years.
This paper focuses on the representation learning of multimodal data to reach higher …

CorMulT: A Semi-supervised Modality Correlation-aware Multimodal Transformer for Sentiment Analysis

Y Li, R Zhu, W Li - arxiv preprint arxiv:2407.07046, 2024 - arxiv.org
Multimodal sentiment analysis is an active research area that combines multiple data
modalities, eg, text, image and audio, to analyze human emotions and benefits a variety of …

AtCAF: Attention-based causality-aware fusion network for multimodal sentiment analysis

C Huang, J Chen, Q Huang, S Wang, Y Tu, X Huang - Information Fusion, 2025 - Elsevier
Multimodal sentiment analysis (MSA) involves interpreting sentiment using various sensory
data modalities. Traditional MSA models often overlook causality between modalities …

Multimodal sentiment analysis based on multi-layer feature fusion and multi-task learning

Y Cai, X Li, Y Zhang, J Li, F Zhu, L Rao - Scientific Reports, 2025 - nature.com
Multimodal sentiment analysis (MSA) aims to use a variety of sensors to obtain and process
information to predict the intensity and polarity of human emotions. The main challenges …

Multimodal Large Language Model with LoRA Fine-Tuning for Multimodal Sentiment Analysis

J Mu, W Wang, W Liu, T Yan, G Wang - ACM Transactions on Intelligent …, 2024 - dl.acm.org
Multimodal sentiment analysis has become a popular research topic in recent years.
However, existing methods have two unaddressed limitations:(1) they use limited …