A review of evaluation practices of gesture generation in embodied conversational agents

P Wolfert, N Robinson… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Embodied conversational agents (ECAs) are often designed to produce nonverbal behavior
to complement or enhance their verbal communication. One such form of the nonverbal …

Analyzing input and output representations for speech-driven gesture generation

T Kucherenko, D Hasegawa, GE Henter… - Proceedings of the 19th …, 2019 - dl.acm.org
This paper presents a novel framework for automatic speech-driven gesture generation,
applicable to human-agent interaction including both virtual agents and robots. Specifically …

A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

T Kucherenko, P Jonell, Y Yoon, P Wolfert… - Proceedings of the 26th …, 2021 - dl.acm.org
Co-speech gestures, gestures that accompany speech, play an important role in human
communication. Automatic co-speech gesture generation is thus a key enabling technology …

What affects the usage of artificial conversational agents? An agent personality and love theory perspective

D Pal, V Vanijja, H Thapliyal, X Zhang - Computers in Human Behavior, 2023 - Elsevier
Artificial-intelligence (AI) powered conversational (CAI) agents have been growing in
popularity. Like human personality, CAI agent personality can also impact the relationship …

Modeling the conditional distribution of co-speech upper body gesture jointly using conditional-GAN and unrolled-GAN

B Wu, C Liu, CT Ishi, H Ishiguro - Electronics, 2021 - mdpi.com
Co-speech gestures are a crucial, non-verbal modality for humans to communicate. Social
agents also need this capability to be more human-like and comprehensive. This study aims …

Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022

T Kucherenko*, P Wolfert*, Y Yoon*, C Viegas… - ACM Transactions on …, 2024 - dl.acm.org
This article reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

HEMVIP: Human evaluation of multiple videos in parallel

P Jonell, Y Yoon, P Wolfert, T Kucherenko… - Proceedings of the 2021 …, 2021 - dl.acm.org
In many research areas, for example motion and gesture generation, objective measures
alone do not provide an accurate impression of key stimulus traits such as perceived quality …

Personality perceptions of conversational agents: A task-based analysis Using Thai as the conversational language

N Soonpipatskul, D Pal, B Watanapa… - IEEE …, 2023 - ieeexplore.ieee.org
Recently there has been a tremendous growth in the popularity of artificial intelligence (AI)
based conversational agents (CA). Their support for anthropomorphism and human-likeness …

Probabilistic human-like gesture synthesis from speech using GRU-based WGAN

B Wu, C Liu, CT Ishi, H Ishiguro - … of the 2021 international conference on …, 2021 - dl.acm.org
Gestures are crucial for increasing the human-likeness of agents and robots to achieve
smoother interactions with humans. The realization of an effective system to model human …

Sequence-to-sequence predictive model: From prosody to communicative gestures

F Yunus, C Clavel, C Pelachaud - International Conference on Human …, 2021 - Springer
Communicative gestures and speech acoustic are tightly linked. Our objective is to predict
the timing of gestures according to the acoustic. That is, we want to predict when a certain …