Gesture and speech in interaction: An overview

P Wagner, Z Malisz, S Kopp - Speech communication, 2014 - Elsevier
Gestures and speech interact. They are linked in language production and perception, with
their interaction contributing to felicitous communication. The multifaceted nature of these …

Modeling feedback in interaction with conversational agents—a review

A Axelsson, H Buschmeier, G Skantze - Frontiers in Computer Science, 2022 - frontiersin.org
Intelligent agents interacting with humans through conversation (such as a robot, embodied
conversational agent, or chatbot) need to receive feedback from the human to make sure …

Analyzing multifunctionality of head movements in face-to-face conversations using deep convolutional neural networks

K Otsuka, M Tsumori - IEEE Access, 2020 - ieeexplore.ieee.org
A functional head-movement corpus and convolutional neural networks (CNNs) for detecting
head-movement functions are presented for analyzing the multiple communicative functions …

Backchannel behavior is idiosyncratic

P Blomsma, J Vaitonyté, G Skantze… - Language and …, 2024 - cambridge.org
In spoken conversations, speakers and their addressees constantly seek and provide
different forms of audiovisual feedback, also known as backchannels, which include …

Dynamics of remote communication: Movement coordination in video-mediated and face-to-face conversations

J Zubek, E Nagórska, J Komorowska-Mach… - Entropy, 2022 - mdpi.com
The present pandemic forced our daily interactions to move into the virtual world. People
had to adapt to new communication media that afford different ways of interaction. Remote …

Backchannel relevance spaces

M Heldner, A Hjalmarsson, J Edlund - Nordic Prosody XI, Tartu …, 2013 - diva-portal.org
This contribution introduces backchannel relevance spaces–intervals where it is relevant for
a listener in a conversation to produce a backchannel. By annotating and comparing actual …

The ALICO corpus: analysing the active listener

Z Malisz, M Włodarczak, H Buschmeier… - Language resources …, 2016 - Springer
Abstract The Active Listening Corpus (ALICO) is a multimodal data set of spontaneous
dyadic conversations in German with diverse speech and gestural annotations of both …

Calmresponses: Displaying collective audience reactions in remote communication

K Maeda, R Arakawa, J Rekimoto - Proceedings of the 2022 ACM …, 2022 - dl.acm.org
We propose a system displaying audience eye gaze and nod reactions for enhancing
synchronous remote communication. Recently, we have had increasing opportunities to …

From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation

T Fauviaux, L Marin, M Parisi, R Schmidt, G Mostafaoui - PloS one, 2024 - journals.plos.org
Conversations encompass continuous exchanges of verbal and nonverbal information.
Previous research has demonstrated that gestures dynamically entrain each other and that …

Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent

B Inden, Z Malisz, P Wagner, I Wachsmuth - Proceedings of the 15th …, 2013 - dl.acm.org
We report on an analysis of feedback behavior in an Active Listening Corpus as produced
verbally, visually (head movement) and bimodally. The behavior is modeled in an embodied …