Didn't see that coming: a survey on non-verbal social human behavior forecasting

G Barquero, J Núnez, S Escalera, Z Xu… - … Social Behavior in …, 2022 - proceedings.mlr.press
Non-verbal social human behavior forecasting has increasingly attracted the interest of the
research community in recent years. Its direct applications to human-robot interaction and …

Multimodal and multitask approach to listener's backchannel prediction: Can prediction of turn-changing and turn-management willingness improve backchannel …

R Ishii, X Ren, M Muszynski, LP Morency - Proceedings of the 21st ACM …, 2021 - dl.acm.org
The listener's backchannel has the important function of encouraging a current speaker to
hold their turn and continue to speak, which enables smooth conversation. The listener …

Automated face-to-face conversation detection on a commodity smartwatch with acoustic sensing

D Liang, A Zhang, E Thomaz - Proceedings of the ACM on Interactive …, 2023 - dl.acm.org
Understanding social interactions is relevant across many domains and applications,
including psychology, behavioral sciences, human computer interaction, and healthcare. In …

Next-speaker prediction based on non-verbal information in multi-party video conversation

S Mizuno, N Hojo, S Kobashikawa… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
We propose a method for next-speaker prediction, a task to predict who speaks in the next
turn among multiple current listeners, in multi-party video conversation. Previous studies …

Automated detection of stressful conversations using wearable physiological and inertial sensors

R Bari, MM Rahman, N Saleheen, MB Parsons… - Proceedings of the …, 2020 - dl.acm.org
Stressful conversation is a frequently occurring stressor in our daily life. Stressors not only
adversely affect our physical and mental health but also our relationships with family …

Multimodal classification of interruptions in humans' interaction

L Yang, C Achard, C Pelachaud - Proceedings of the 2022 International …, 2022 - dl.acm.org
During an interaction interruptions occur frequently. Interruptions may arise to fulfill different
goals such as changing the topic of conversation abruptly, asking for clarification …

Multimodal Analysis of Interruptions

L Yang, C Achard, C Pelachaud - International Conference on Human …, 2022 - Springer
During an interaction, interactants exchange speaking turns. Exchanges can be done
smoothly or through interruptions. Listeners can display backchannels, send signals to grab …

Talking Turns: Benchmarking Audio Foundation Models on Turn-Taking Dynamics

S Arora, Z Lu, CC Chiu, R Pang, S Watanabe - The Thirteenth International … - openreview.net
The recent wave of audio foundation models (FMs) could provide new capabilities for
conversational modeling. However, there have been limited efforts to evaluate these audio …

Modeling Lead-Lag Structure in Facial Expression Synchrony for Social-Psychological Outcome Prediction from Negotiation Interaction

N Hojo, S Mizuno, S Kobashikawa… - … on Acoustics, Speech …, 2023 - ieeexplore.ieee.org
This study proposes introducing facial-expression synchrony features to machine learning to
estimate a customer's psychological information from online business negotiation dialogue …