Analyzing multifunctionality of head movements in face-to-face conversations using deep convolutional neural networks

K Otsuka, M Tsumori - IEEE Access, 2020 - ieeexplore.ieee.org
A functional head-movement corpus and convolutional neural networks (CNNs) for detecting
head-movement functions are presented for analyzing the multiple communicative functions …

[書籍][B] Constructive dialogue modelling: Speech interaction and rational agents

K Jokinen - 2009 - books.google.com
Dialogue management technology has developed rapidly over the years resulting in real-
time applications like telephony directories, timetable enquiries, and in-car applications …

The NOMCO multimodal Nordic resource: goals and characteristics

P Paggio, J Allwood, E Ahlsén, K Jokinen - 2010 - diva-portal.org
This paper presents the multimodal corpora that are being collected and annotated in the
Nordic NOMCO project. The corpora will be used to study communicative phenomena such …

Gesture generation

C Saund, S Marsella - The Handbook on Socially Interactive Agents: 20 …, 2021 - dl.acm.org
Gestures accompany our speech in ways that punctuate, augment, substitute for, and even
contradict verbal information. Such co-speech gestures draw listeners' attention to specific …

Eye-gaze experiments for conversation monitoring

K Jokinen, M Nishida, S Yamamoto - Proceedings of the 3rd international …, 2009 - dl.acm.org
Eye-tracking technology has recently been matured so that its use in studies dealing with
unobtrusive and natural user experiments has become easier to conduct. Simultaneously …

Head movements, facial expressions and feedback in danish first encounters interactions: A culture-specific analysis

P Paggio, C Navarretta - Universal Access in Human-Computer Interaction …, 2011 - Springer
This study deals with non-verbal behaviour in a video-recorded and manually annotated
corpus of first encounters in Danish. It presents an analysis of head movements and facial …

Head movements, facial expressions and feedback in conversations: empirical evidence from Danish multimodal data

P Paggio, C Navarretta - Journal on Multimodal User Interfaces, 2013 - Springer
This article deals with multimodal feedback in two Danish multimodal corpora, ie, a
collection of map-task dialogues and a corpus of free conversations in first encounters …

[PDF][PDF] Turn taking, utterance density, and gaze patterns as cues to conversational activity

K Jokinen - Proceedings of ICMI 2011 Workshop Multimodal …, 2011 - researchgate.net
Conversational activity can be measured in many ways, and often it is related to the
participants' turn-taking and feedback activity: the more the participants speak, ie produce …

Individuality in communicative bodily behaviours

C Navarretta - … Systems: COST 2102 International Training School …, 2012 - Springer
This paper investigates to which extent participants in spontaneously occurring interactions
can be recognised automatically from the shape description of their bodily behaviours. For …

[PDF][PDF] Classification of feedback expressions in multimodal data

C Navarretta, P Paggio - … of the ACL 2010 Conference Short …, 2010 - aclanthology.org
This paper addresses the issue of how linguistic feedback expressions, prosody and head
gestures, ie head movements and face expressions, relate to one another in a collection of …