A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation

L Liu, L Gao, W Lei, F Ma, X Lin, J Wang - ar** human-like conversational agents is a prime area in HCI research and
subsumes many tasks. Predicting listener backchannels is one such actively-researched …

MultiMediate'22: Backchannel Detection and Agreement Estimation in Group Interactions

P Müller, M Dietz, D Schiller, D Thomas… - Proceedings of the 30th …, 2022 - dl.acm.org
Backchannels, ie short interjections of the listener, serve important meta-conversational
purposes like signifying attention or indicating agreement. Despite their key role, automatic …

A Bayesian theory of mind approach to nonverbal communication

JJ Lee, F Sha, C Breazeal - 2019 14th ACM/IEEE International …, 2019 - ieeexplore.ieee.org
This paper defines a dual computational framework to nonverbal communication for human-
robot interactions. We use a Bayesian Theory of Mind approach to model dyadic storytelling …

Towards social & engaging peer learning: Predicting backchanneling and disengagement in children

M Goswami, M Manuja, M Leekha - arxiv preprint arxiv:2007.11346, 2020 - arxiv.org
Social robots and interactive computer applications have the potential to foster early
language development in young children by acting as peer learning companions. However …

A sibling interaction analysis dataset (SIBD): a scenario of screen-free programmable robotics in Chinese households

X Liu, Y **, T Lao, P Chen, L Sun, W You… - Interactive Learning …, 2024 - Taylor & Francis
In China, with the rise of multi-child families, enhancing interactions between siblings to
promote their mutual learning has been receiving widespread attention. Among the …

Multimodal user feedback during adaptive robot-human presentations

A Axelsson, G Skantze - Frontiers in Computer Science, 2022 - frontiersin.org
Feedback is an essential part of all communication, and agents communicating with humans
must be able to both give and receive feedback in order to ensure mutual understanding. In …

SMILEY—assistive application to support social and emotional skills in SPCD individuals

M Chawla, SN Panda, V Khullar - Medical & Biological Engineering & …, 2024 - Springer
According to the available studies, mobile applications have provided significant support in
improving the diverse skills of special individuals with social pragmatic communication …

QUB-PHEO: A Visual-Based Dyadic Multi-View Dataset for Intention Inference in Collaborative Assembly

S Adebayo, S McLoone, JC Dessing - IEEE Access, 2024 - ieeexplore.ieee.org
QUB-PHEO introduces a visual-based, dyadic dataset with the potential of advancing
human-robot interaction (HRI) research in assembly operations and intention inference. This …