Communication comprises a wealth of multimodal signals (eg, gestures, eye gaze,
intonation) in addition to speech and there is a growing interest in the study of multimodal …

Manual co-speech gestures can facilitate language comprehension, especially in adverse
listening conditions. However, we do not know whether gestures influence simultaneous …

This paper explores the grounding issue regarding multimodal semantic representation from
a computational cognitive-linguistic view. We annotate images from the Flickr30k dataset …

All languages have demonstratives—grammatical words like 'this' and 'that'in English, which
are a universal tool to establish joint attention on a referent. Demonstratives are acquired …

Verbal descriptions of spatial configurations open a window to a specific aspect of visual
cognition relevant to the interpretation of topological relations in the visual world. The …

This thesis explored the relationship between video game experience, spatial cognition, and
multimodal language use during a route description task. The study included forty-six …

When people communicate, they use a combination of modalities-speech, gesture and eye
gaze-to engage and transmit information to an addressee. Deictic communication is a …

This dissertation focused on crosslinguistic influence (CLI) in the research field of second
and third language acquisition, bilingualism, heritage speakers and multilingualism. The …

This study investigates audio-visual crossmodal connectivity during the perception of
distorted speech using task-based functional magnetic resonance imaging (fMRI). A …

For videos of oral presentations using visual materials such as photographs and diagrams, it
is known that the viewers' comprehension is improved if the presenters appear in the frame …