Abaw: Valence-arousal estimation, expression recognition, action unit detection & emotional reaction intensity estimation challenges

D Kollias, P Tzirakis, A Baird… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract The fifth Affective Behavior Analysis in-the-wild (ABAW) Competition is part of the
respective ABAW Workshop which will be held in conjunction with IEEE Computer Vision …

The muse 2023 multimodal sentiment analysis challenge: Mimicked emotions, cross-cultural humour, and personalisation

L Christ, S Amiriparian, A Baird, A Kathan… - Proceedings of the 4th …, 2023 - dl.acm.org
The Multimodal Sentiment Analysis Challenge (MuSe) 2023 is a set of shared tasks
addressing three different contemporary multimodal affect and sentiment analysis problems …

Using transformers for multimodal emotion recognition: Taxonomies and state of the art review

S Hazmoune, F Bougamouza - Engineering Applications of Artificial …, 2024 - Elsevier
Emotion recognition is an aspect of human-computer interaction, affective computing, and
social robotics. Conventional unimodal approaches for emotion recognition, depending on …

Multimodal feature extraction and fusion for emotional reaction intensity estimation and expression classification in videos with transformers

J Li, Y Chen, X Zhang, J Nie, Z Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we present our advanced solutions to the two sub-challenges of Affective
Behavior Analysis in the wild (ABAW) 2023: the Emotional Reaction Intensity (ERI) …

Facernet: a facial expression intensity estimation network

D Kollias, A Psaroudakis, A Arsenos… - arxiv preprint arxiv …, 2023 - arxiv.org
This paper presents our approach for Facial Expression Intensity Estimation from videos. It
includes two components: i) a representation extractor network that extracts various emotion …

A dual branch network for emotional reaction intensity estimation

J Yu, J Zhu, W Zhu, Z Cai, G **e, R Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Emotional Reaction Intensity (ERI) estimation is an important task in multimodal
scenarios, and has fundamental applications in medicine, safe driving and other fields. In …

Multimodal Cross-Lingual Features and Weight Fusion for Cross-Cultural Humor Detection

H **e, J Cui, Y Cao, J Chen, J Tao, C Fan… - Proceedings of the 4th …, 2023 - dl.acm.org
Sentiment analysis plays a crucial role in interpreting human interactions across different
modalities. This paper addresses the Cross-Cultural Multilingual Humour Detection Sub …

Multimodal Sentiment Analysis via Efficient Multimodal Transformer and Modality-Aware Adaptive Training Strategy

C Ding, D Zong, B Li, S Zhang, X Zhu, G Zhong… - Proceedings of the 4th …, 2023 - dl.acm.org
In this paper, we present the solution to the MuSe-Mimic subchallenge of the 4th Multimodal
Sentiment Analysis Challenge. This sub-challenge aims to predict the level of approval …

Uncovering the Unseen: Discover Hidden Intentions by Micro-Behavior Graph Reasoning

Z Zhou, W Liu, D Xu, Z Wang, J Zhao - Proceedings of the 31st ACM …, 2023 - dl.acm.org
This paper introduces a new and challenging Hidden Intention Discovery (HID) task. Unlike
existing intention recognition tasks, which are based on obvious visual representations to …

Abaw5 challenge: a facial affect recognition approach utilizing transformer encoder and audiovisual fusion

Z Zhang, L An, Z Cui, A Xu, T Dong… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we present our approach to tackling the 5th Workshop and Competition on
Affective Behavior Analysis in-the-wild (ABAW). The competition comprises four sub …