A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

[BOOK][B] The Handbook on Socially Interactive Agents: 20 Years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics …

B Lugrin, C Pelachaud, D Traum - 2022 - dl.acm.org
The Handbook on Socially Interactive Agents provides a comprehensive overview of the
research fields of Embodied Conversational Agents, Intelligent Virtual Agents, and Social …

Alignment in multimodal interaction: An integrative framework

M Rasenberg, A Özyürek, M Dingemanse - Cognitive science, 2020 - Wiley Online Library
When people are engaged in social interaction, they can repeat aspects of each other's
communicative behavior, such as words or gestures. This kind of behavioral alignment has …

[HTML][HTML] The CABB dataset: A multimodal corpus of communicative interactions for behavioural and neural analyses

L Eijk, M Rasenberg, F Arnese, M Blokpoel… - NeuroImage, 2022 - Elsevier
We present a dataset of behavioural and fMRI observations acquired in the context of
humans involved in multimodal referential communication. The dataset contains audio/video …

[HTML][HTML] It's alignment all the way down, but not all the way up: Speakers align on some features but not others within a dialogue

R Ostrand, E Chodroff - Journal of phonetics, 2021 - Elsevier
During conversation, speakers modulate characteristics of their production to match their
interlocutors' characteristics. This behavior is known as alignment. Speakers align at many …

Definitions of engagement in human-agent interaction

N Glas, C Pelachaud - 2015 International Conference on …, 2015 - ieeexplore.ieee.org
We give an overview of engagement in human-agent interaction. We discuss the different
definitions of engagement in human and social science, specify how they relate to certain …

An alternative to map** a word onto a concept in language acquisition: Pragmatic frames

KJ Rohlfing, B Wrede, AL Vollmer… - Frontiers in …, 2016 - frontiersin.org
The classic map** metaphor posits that children learn a word by map** it onto a
concept of an object or event. However, we believe that a map** metaphor cannot …

Rapport between humans and socially interactive agents

J Gratch, G Lucas - The Handbook on Socially Interactive Agents: 20 …, 2021 - dl.acm.org
Think back on a time when you saw speakers engrossed in conversation. Even with out
hearing their words you can sense their connection. The participants seem tightly enmeshed …

The primacy of multimodal alignment in converging on shared symbols for novel referents

M Rasenberg, A Özyürek, S Bögels… - Discourse …, 2022 - Taylor & Francis
When people interact to establish shared symbols for novel objects or concepts, they often
rely on multiple communicative modalities as well as on alignment (ie, cross-participant …

Data-based analysis of speech and gesture: The Bielefeld Speech and Gesture Alignment Corpus (SaGA) and its applications

A Lücking, K Bergman, F Hahn, S Kopp… - Journal on Multimodal …, 2013 - Springer
Communicating face-to-face, interlocutors frequently produce multimodal meaning
packages consisting of speech and accompanying gestures. We discuss a systematically …