Evaluating significant features in context‐aware multimodal emotion recognition with XAI methods

A Khalane, R Makwana, T Shaikh, A Ullah - Expert Systems, 2025 - Wiley Online Library
Expert systems are being extensively used to make critical decisions involving emotional
analysis in affective computing. The evolution of deep learning algorithms has improved the …

Evolutionary topology search for tensor network decomposition

C Li, Z Sun - International Conference on Machine Learning, 2020 - proceedings.mlr.press
Tensor network (TN) decomposition is a promising framework to represent extremely high-
dimensional problems with few parameters. However, it is challenging to search the (near-) …

COM: Contrastive Masked-attention model for incomplete multimodal learning

S Qian, C Wang - Neural Networks, 2023 - Elsevier
Most multimodal learning methods assume that all modalities are always available in data.
However, in real-world applications, the assumption is often violated due to privacy …

Noise imitation based adversarial training for robust multimodal sentiment analysis

Z Yuan, Y Liu, H Xu, K Gao - IEEE Transactions on Multimedia, 2023 - ieeexplore.ieee.org
As an inevitable phenomenon in real-world applications, data imperfection has emerged as
one of the most critical challenges for multimodal sentiment analysis. However, existing …

Robust-MSA: Understanding the impact of modality noise on multimodal sentiment analysis

H Mao, B Zhang, H Xu, Z Yuan, Y Liu - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Improving model robustness against potential modality noise, as an essential step for
adapting multimodal models to real-world applications, has received increasing attention …

On the memory mechanism of tensor-power recurrent models

H Qiu, C Li, Y Weng, Z Sun, X He… - … Conference on Artificial …, 2021 - proceedings.mlr.press
Tensor-power (TP) recurrent model is a family of non-linear dynamical systems, of which the
recurrence relation consists of a p-fold (aka, degree-p) tensor product. Despite such the …

Modality-collaborative transformer with hybrid feature reconstruction for robust emotion recognition

C Chen, P Zhang - ACM Transactions on Multimedia Computing …, 2024 - dl.acm.org
As a vital aspect of affective computing, Multimodal Emotion Recognition has been an active
research area in the multimedia community. Despite recent progress, this field still confronts …

Fractional Tensor Recurrent Unit (fTRU): A Stable Forecasting Model With Long Memory

H Qiu, C Li, Y Weng, Z Sun… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The tensor recurrent model is a family of nonlinear dynamical systems, of which the
recurrence relation consists of a-fold (called degree-) tensor product. Despite such models …

Meta Noise Adaption Framework for Multimodal Sentiment Analysis With Feature Noise

Z Yuan, B Zhang, H Xu, K Gao - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Improving the robustness of models against feature noise has emerged as one of the most
crucial research topics in the field of multimodal sentiment analysis. Recent studies assume …

OpenVNA: A Framework for Analyzing the Behavior of Multimodal Language Understanding System under Noisy Scenarios

Z Yuan, B Zhang, H Xu, Z Liang, K Gao - arxiv preprint arxiv:2407.02773, 2024 - arxiv.org
We present OpenVNA, an open-source framework designed for analyzing the behavior of
multimodal language understanding systems under noisy conditions. OpenVNA serves as …