Decoding lip language using triboelectric sensors with deep learning

Y Lu, H Tian, J Cheng, F Zhu, B Liu, S Wei, L Ji… - Nature …, 2022 - nature.com
Lip language is an effective method of voice-off communication in daily life for people with
vocal cord lesions and laryngeal and lingual injuries without occupying the hands …

EchoSpeech: Continuous Silent Speech Recognition on Minimally-obtrusive Eyewear Powered by Acoustic Sensing

R Zhang, K Li, Y Hao, Y Wang, Z Lai… - Proceedings of the …, 2023 - dl.acm.org
We present EchoSpeech, a minimally-obtrusive silent speech interface (SSI) powered by
low-power active acoustic sensing. EchoSpeech uses speakers and microphones mounted …

EarCommand: " Hearing" Your Silent Speech Commands In Ear

Y **, Y Gao, X Xu, S Choi, J Li, F Liu, Z Li… - Proceedings of the ACM …, 2022 - dl.acm.org
Intelligent speech interfaces have been develo** vastly to support the growing demands
for convenient control and interaction with wearable/earable and portable devices. To avoid …

Muteit: Jaw motion based unvoiced command recognition using earable

T Srivastava, P Khanna, S Pan, P Nguyen… - Proceedings of the ACM …, 2022 - dl.acm.org
In this paper, we present MuteIt, an ear-worn system for recognizing unvoiced human
commands. MuteIt presents an intuitive alternative to voice-based interactions that can be …

mSilent: Towards general corpus silent speech recognition using COTS mmWave radar

S Zeng, H Wan, S Shi, W Wang - Proceedings of the ACM on Interactive …, 2023 - dl.acm.org
Silent speech recognition (SSR) allows users to speak to the device without making a
sound, avoiding being overheard or disturbing others. Compared to the video-based …

EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses

K Li, R Zhang, S Chen, B Chen, M Sakashita… - Proceedings of the CHI …, 2024 - dl.acm.org
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system
designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of …

Amaging: Acoustic hand imaging for self-adaptive gesture recognition

P Wang, R Jiang, C Liu - IEEE INFOCOM 2022-IEEE …, 2022 - ieeexplore.ieee.org
A practical challenge common to state-of-the-art acoustic gesture recognition techniques is
to adaptively respond to intended gestures rather than unintended motions during the real …

Sonicasl: An acoustic-based sign language gesture recognizer using earphones

Y **, Y Gao, Y Zhu, W Wang, J Li, S Choi, Z Li… - Proceedings of the …, 2021 - dl.acm.org
We propose SonicASL, a real-time gesture recognition system that can recognize sign
language gestures on the fly, leveraging front-facing microphones and speakers added to …

Beyond the pixel world: A novel acoustic-based face anti-spoofing system for smartphones

C Kong, K Zheng, S Wang, A Rocha… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
2D face presentation attacks are one of the most notorious and pervasive face spoofing
types, which have caused pressing security issues to facial authentication systems. While …

Sensing to hear: Speech enhancement for mobile devices using acoustic signals

Q Zhang, D Wang, R Zhao, Y Yu, J Shen - Proceedings of the ACM on …, 2021 - dl.acm.org
Voice interactions and voice messages on mobile phones are rapidly growing in popularity.
However, the user experience of these services is still worse than desired in noisy …