Automatic multimodal assessment of soft skills in social interactions: a review

S Rasipuram, DB Jayagopi - Multimedia Tools and Applications, 2020 - Springer
Automatic assessment of soft skills is an interesting problem in social computing. Soft skills
are essential to any individual for personal and career development. Soft skills assessment …

A survey on data-driven evaluation of competencies and capabilities across multimedia environments

The rapid evolution of technology directly impacts the skills and jobs needed in the next
decade. Users can, intentionally or unintentionally, develop different skills by creating …

Emotion Recognition in Self-Regulated Learning: Advancing Metacognition through AI-Assisted Reflections

S Chen, H Cheng, Y Huang - Trust and Inclusion in AI-Mediated Education …, 2024 - Springer
Metacognition, understood as the awareness of one's own learning processes, plays a
pivotal role in achieving effective learning outcomes. Recent work has shown the potential of …

Engauge: Engagement gauge of meeting participants estimated by facial expression and deep neural network

K Watanabe, T Sathyanarayana, A Dengel… - IEEE …, 2023 - ieeexplore.ieee.org
Measuring the level of engagement among participants in a meeting is crucial for evaluating
collective understanding. While previous studies have utilized multiple sensors, such as …

Voicecoach: Interactive evidence-based training for voice modulation skills in public speaking

X Wang, H Zeng, Y Wang, A Wu, Z Sun, X Ma… - Proceedings of the 2020 …, 2020 - dl.acm.org
The modulation of voice properties, such as pitch, volume, and speed, is crucial for
delivering a successful public speech. However, it is challenging to master different voice …

Discaas: Micro behavior analysis on discussion by camera as a sensor

K Watanabe, Y Soneda, Y Matsuda, Y Nakamura… - Sensors, 2021 - mdpi.com
The emergence of various types of commercial cameras (compact, high resolution, high
angle of view, high speed, and high dynamic range, etc.) has contributed significantly to the …

Training public speaking with virtual social interactions: Effectiveness of real-time feedback and delayed feedback

M Chollet, S Marsella, S Scherer - Journal on Multimodal User Interfaces, 2022 - Springer
Social signal processing and virtual social interaction technologies have allowed the
creation of social skills training applications, and initial studies have shown that such …

Inclusive Emotion Technologies: Addressing the Needs of d/Deaf and Hard of Hearing Learners in Video-Based Learning

S Chen, J Situ, H Cheng, S Su, D Kirst, L Ming… - ar** with Stuttering in China
L Feng, Z **ong, X Li, M Fan - Proceedings of the 2023 CHI Conference …, 2023 - dl.acm.org
Stuttering is a speech disorder influencing over 70 million people worldwide, including 13
million in China. It causes low self-esteem among other detrimental effects on people who …

MirrorUs: Mirroring Peers' Affective Cues to Promote Learner's Meta-Cognition in Video-based Learning

S Chen, J Situ, H Cheng, D Kirst, Y Huang - Proceedings of the ACM on …, 2023 - dl.acm.org
Learners' awareness of their own affective states (emotions) can improve their meta-
cognition, which is a critical skill of being aware of and controlling one's cognitive …