Gesture and speech in interaction: An overview
Gestures and speech interact. They are linked in language production and perception, with
their interaction contributing to felicitous communication. The multifaceted nature of these …
their interaction contributing to felicitous communication. The multifaceted nature of these …
Modeling feedback in interaction with conversational agents—a review
Intelligent agents interacting with humans through conversation (such as a robot, embodied
conversational agent, or chatbot) need to receive feedback from the human to make sure …
conversational agent, or chatbot) need to receive feedback from the human to make sure …
Analyzing multifunctionality of head movements in face-to-face conversations using deep convolutional neural networks
K Otsuka, M Tsumori - IEEE Access, 2020 - ieeexplore.ieee.org
A functional head-movement corpus and convolutional neural networks (CNNs) for detecting
head-movement functions are presented for analyzing the multiple communicative functions …
head-movement functions are presented for analyzing the multiple communicative functions …
Backchannel behavior is idiosyncratic
In spoken conversations, speakers and their addressees constantly seek and provide
different forms of audiovisual feedback, also known as backchannels, which include …
different forms of audiovisual feedback, also known as backchannels, which include …
Dynamics of remote communication: Movement coordination in video-mediated and face-to-face conversations
The present pandemic forced our daily interactions to move into the virtual world. People
had to adapt to new communication media that afford different ways of interaction. Remote …
had to adapt to new communication media that afford different ways of interaction. Remote …
Backchannel relevance spaces
This contribution introduces backchannel relevance spaces–intervals where it is relevant for
a listener in a conversation to produce a backchannel. By annotating and comparing actual …
a listener in a conversation to produce a backchannel. By annotating and comparing actual …
The ALICO corpus: analysing the active listener
Abstract The Active Listening Corpus (ALICO) is a multimodal data set of spontaneous
dyadic conversations in German with diverse speech and gestural annotations of both …
dyadic conversations in German with diverse speech and gestural annotations of both …
Calmresponses: Displaying collective audience reactions in remote communication
We propose a system displaying audience eye gaze and nod reactions for enhancing
synchronous remote communication. Recently, we have had increasing opportunities to …
synchronous remote communication. Recently, we have had increasing opportunities to …
From unimodal to multimodal dynamics of verbal and nonverbal cues during unstructured conversation
Conversations encompass continuous exchanges of verbal and nonverbal information.
Previous research has demonstrated that gestures dynamically entrain each other and that …
Previous research has demonstrated that gestures dynamically entrain each other and that …
Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent
We report on an analysis of feedback behavior in an Active Listening Corpus as produced
verbally, visually (head movement) and bimodally. The behavior is modeled in an embodied …
verbally, visually (head movement) and bimodally. The behavior is modeled in an embodied …