[HTML][HTML] A survey on Sign Language machine translation

A Núñez-Marcos, O Perez-de-Viñaspre… - Expert Systems with …, 2023‏ - Elsevier
Abstract Sign Languages (SLs) are employed by deaf and hard-of-hearing (DHH) people to
communicate on a daily basis. However, the communication with hearing people still faces …

Robotic vision for human-robot interaction and collaboration: A survey and systematic review

N Robinson, B Tidd, D Campbell, D Kulić… - ACM Transactions on …, 2023‏ - dl.acm.org
Robotic vision, otherwise known as computer vision for robots, is a critical process for robots
to collect and interpret detailed information related to human actions, goals, and …

Multimodal large language models: A survey

J Wu, W Gan, Z Chen, S Wan… - 2023 IEEE International …, 2023‏ - ieeexplore.ieee.org
The exploration of multimodal language models integrates multiple data types, such as
images, text, language, audio, and other heterogeneity. While the latest large language …

Two-stream network for sign language recognition and translation

Y Chen, R Zuo, F Wei, Y Wu, S Liu… - Advances in Neural …, 2022‏ - proceedings.neurips.cc
Sign languages are visual languages using manual articulations and non-manual elements
to convey information. For sign language recognition and translation, the majority of existing …

Learning audio-visual speech representation by masked multimodal cluster prediction

B Shi, WN Hsu, K Lakhotia, A Mohamed - arxiv preprint arxiv:2201.02184, 2022‏ - arxiv.org
Video recordings of speech contain correlated audio and visual information, providing a
strong signal for speech representation learning from the speaker's lip movements and the …

A simple multi-modality transfer learning baseline for sign language translation

Y Chen, F Wei, X Sun, Z Wu… - Proceedings of the IEEE …, 2022‏ - openaccess.thecvf.com
This paper proposes a simple transfer learning baseline for sign language translation.
Existing sign language datasets (eg PHOENIX-2014T, CSL-Daily) contain only about 10K …

Improving sign language translation with monolingual data by sign back-translation

H Zhou, W Zhou, W Qi, J Pu… - Proceedings of the IEEE …, 2021‏ - openaccess.thecvf.com
Despite existing pioneering works on sign language translation (SLT), there is a non-trivial
obstacle, ie, the limited quantity of parallel sign-text data. To tackle this parallel data …

Natural language-assisted sign language recognition

R Zuo, F Wei, B Mak - … of the IEEE/CVF conference on …, 2023‏ - openaccess.thecvf.com
Sign languages are visual languages which convey information by signers' handshape,
facial expression, body movement, and so forth. Due to the inherent restriction of …

Signbert+: Hand-model-aware self-supervised pre-training for sign language understanding

H Hu, W Zhao, W Zhou, H Li - IEEE Transactions on Pattern …, 2023‏ - ieeexplore.ieee.org
Hand gesture serves as a crucial role during the expression of sign language. Current deep
learning based methods for sign language understanding (SLU) are prone to over-fitting due …

How2sign: a large-scale multimodal dataset for continuous american sign language

A Duarte, S Palaskar, L Ventura… - Proceedings of the …, 2021‏ - openaccess.thecvf.com
One of the factors that have hindered progress in the areas of sign language recognition,
translation, and production is the absence of large annotated datasets. Towards this end, we …