A comprehensive review of sign language recognition: Different types, modalities, and datasets

M Madhiarasan, PP Roy - arxiv preprint arxiv:2204.03328, 2022 - arxiv.org
A machine can understand human activities, and the meaning of signs can help overcome
the communication barriers between the inaudible and ordinary people. Sign Language …

Signbert+: Hand-model-aware self-supervised pre-training for sign language understanding

H Hu, W Zhao, W Zhou, H Li - IEEE Transactions on Pattern …, 2023 - ieeexplore.ieee.org
Hand gesture serves as a crucial role during the expression of sign language. Current deep
learning based methods for sign language understanding (SLU) are prone to over-fitting due …

Natural language-assisted sign language recognition

R Zuo, F Wei, B Mak - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Sign languages are visual languages which convey information by signers' handshape,
facial expression, body movement, and so forth. Due to the inherent restriction of …

SignBERT: Pre-training of hand-model-aware representation for sign language recognition

H Hu, W Zhao, W Zhou, Y Wang… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Hand gesture serves as a critical role in sign language. Current deep-learning-based sign
language recognition (SLR) methods may suffer insufficient interpretability and overfitting …

Automatic dense annotation of large-vocabulary sign language videos

L Momeni, H Bull, KR Prajwal, S Albanie… - … on Computer Vision, 2022 - Springer
Recently, sign language researchers have turned to sign language interpreted TV
broadcasts, comprising (i) a video of continuous signing and (ii) subtitles corresponding to …

BEST: BERT pre-training for sign language recognition with coupling tokenization

W Zhao, H Hu, W Zhou, J Shi, H Li - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
In this work, we are dedicated to leveraging the BERT pre-training success and modeling
the domain-specific statistics to fertilize the sign language recognition~(SLR) model …

Isolated arabic sign language recognition using a transformer-based model and landmark keypoints

S Alyami, H Luqman, M Hammoudeh - ACM Transactions on Asian and …, 2024 - dl.acm.org
Pose-based approaches for sign language recognition provide light-weight and fast models
that can be adopted in real-time applications. This article presents a framework for isolated …

Hand-model-aware sign language recognition

H Hu, W Zhou, H Li - Proceedings of the AAAI conference on artificial …, 2021 - ojs.aaai.org
Hand gestures play a dominant role in the expression of sign language. Current deep-
learning based video sign language recognition (SLR) methods usually follow a data-driven …

Using motion history images with 3d convolutional networks in isolated sign language recognition

OM Sincan, HY Keles - IEEE access, 2022 - ieeexplore.ieee.org
Sign language recognition using computational models is a challenging problem that
requires simultaneous spatio-temporal modeling of the multiple sources, ie faces, hands …

Sign language recognition via skeleton-aware multi-model ensemble

S Jiang, B Sun, L Wang, Y Bai, K Li, Y Fu - arxiv preprint arxiv:2110.06161, 2021 - arxiv.org
Sign language is commonly used by deaf or mute people to communicate but requires
extensive effort to master. It is usually performed with the fast yet delicate movement of hand …