Sign language recognition, generation, and translation: An interdisciplinary perspective

D Bragg, O Koller, M Bellard, L Berke… - Proceedings of the 21st …, 2019 - dl.acm.org
Develo** successful sign language recognition, generation, and translation systems
requires expertise in a wide range of fields, including computer vision, computer graphics …

Evolution and Trends in Sign Language Avatar Systems: Unveiling a 40-Year Journey via Systematic Review

M Aziz, A Othman - Multimodal Technologies and Interaction, 2023 - mdpi.com
Sign language (SL) avatar systems aid communication between the hearing and deaf
communities. Despite technological progress, there is a lack of a standardized avatar …

Large language models for multi-modal human-robot interaction

C Wang, S Hasler, D Tanneberg, F Ocker… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper presents an innovative large language model (LLM)-based robotic system for
enhancing multi-modal human-robot interaction (HRI). Traditional HRI systems relied on …

Accessible tourism for the deaf via mobile apps

F Milicchio, M Prosperi - Proceedings of the 9th ACM International …, 2016 - dl.acm.org
Accessible tourism seeks to integrate people with impaired abilities--eg mobility, vision,
hearing--in travel and leisure activities. The attention to this field has been growing in the …

An approach to elicit human-understandable robot expressions to support human-robot interaction

J Leusmann, S Villa, T Liang, C Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Understanding the intentions of robots is essential for natural and seamless human-robot
collaboration. Ensuring that robots have means for non-verbal communication is a basis for …

Animation of fingerspelled words and number signs of the Sinhala sign language

M Punchimudiyanse, RGN Meegama - ACM Transactions on Asian and …, 2017 - dl.acm.org
Sign language is the primary communication medium of the aurally handicapped
community. Often, a sign gesture is mapped to a word or a phrase in a spoken language and …

ASL-Homework-RGBD Dataset: An annotated dataset of 45 fluent and non-fluent signers performing American Sign Language homeworks

S Hassan, M Seita, L Berke, Y Tian, E Gale… - arxiv preprint arxiv …, 2022 - arxiv.org
We are releasing a dataset containing videos of both fluent and non-fluent signers using
American Sign Language (ASL), which were collected using a Kinect v2 sensor. This …

[PDF][PDF] Exploiting motion capture for virtual human animation

A Heloir, M Neff, M Kipp - Proceedings of the Workshop on Multimodal …, 2010 - Citeseer
Motion capture (mocap) provides highly precise data of human movement which can be
used for empirical analysis and virtual human animation. In this paper, we describe a corpus …

[PDF][PDF] Sign Language Corpora for Analysis, Processing and Evaluation.

A Braffort, L Bolot, E Chételat-Pelé, A Choisier… - LREC, 2010 - lrec.elra.info
Abstract Sign Languages (SLs) are the visuo-gestural languages practised by the deaf
communities. Research on SLs requires to build, to analyse and to use corpora. The aim of …

Towards Fully Automated Motion Capture of Signs--Development and Evaluation of a Key Word Signing Avatar

S Alexanderson, J Beskow - ACM Transactions on Accessible …, 2015 - dl.acm.org
Motion capture of signs provides unique challenges in the field of multimodal data collection.
The dense packaging of visual information requires high fidelity and high bandwidth of the …