A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions

A Barua, MU Ahmed, S Begum - Ieee access, 2023 - ieeexplore.ieee.org
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …

Emotion detection: a technology review

JM Garcia-Garcia, VMR Penichet… - Proceedings of the XVIII …, 2017 - dl.acm.org
Emotion detection has become one of the most important aspects to consider in any project
related to Affective Computing. Due to the almost endless applications of this new discipline …

The psychophysiology primer: a guide to methods and a broad review with a focus on human–computer interaction

B Cowley, M Filetti, K Lukander… - … and Trends® in …, 2016 - nowpublishers.com
Digital monitoring of physiological signals can allow computer systems to adapt
unobtrusively to users, so as to enhance personalised 'smart'interactions. In recent years …

The TARDIS framework: intelligent virtual agents for social coaching in job interviews

K Anderson, E André, T Baur, S Bernardini… - … conference on advances …, 2013 - Springer
The TARDIS project aims to build a scenario-based serious-game simulation platform for
NEETs and job-inclusion associations that supports social training and coaching in the …

The social signal interpretation (SSI) framework: multimodal signal processing and recognition in real-time

J Wagner, F Lingenfelser, T Baur, I Damian… - Proceedings of the 21st …, 2013 - dl.acm.org
Automatic detection and interpretation of social signals carried by voice, gestures, mimics,
etc. will play a key-role for next-generation interfaces as it paves the way towards a more …

Read between the lines: An annotation tool for multimodal data for learning

D Di Mitri, J Schneider, R Klemke, M Specht… - Proceedings of the 9th …, 2019 - dl.acm.org
This paper introduces the Visual Inspection Tool (VIT) which supports researchers in the
annotation of multimodal data as well as the processing and exploitation for learning …

A review of multimodal learning analytics architectures

SK Shankar, LP Prieto… - 2018 IEEE 18th …, 2018 - ieeexplore.ieee.org
There is an increasing interest in Multimodal Learning Analytics (MMLA), which involves
complex technical issues in gathering, merging and analyzing different types of learning …

MultiSense—Context-aware nonverbal behavior analysis framework: A psychological distress use case

G Stratou, LP Morency - IEEE Transactions on Affective …, 2017 - ieeexplore.ieee.org
During face-to-face interactions, people naturally integrate nonverbal behaviors such as
facial expressions and body postures as part of the conversation to infer the communicative …

Towards real-time speech emotion recognition for affective e-learning

K Bahreini, R Nadolski, W Westera - Education and information …, 2016 - Springer
This paper presents the voice emotion recognition part of the FILTWAM framework for real-
time emotion recognition in affective e-learning settings. FILTWAM (Framework for Improving …

Laugh-aware virtual agent and its impact on user amusement

R Niewiadomski, J Hofmann, J Urbain, T Platt… - 2013 - zora.uzh.ch
In this paper we present a complete interactive system enabled to detect human laughs and
respond appropriately, by integrating the information of the human behavior and the context …