Echowrist: Continuous hand pose tracking and hand-object interaction recognition using low-power active acoustic sensing on a wristband

CJ Lee, R Zhang, D Agarwal, TC Yu, V Gunda… - Proceedings of the …, 2024 - dl.acm.org
Our hands serve as a fundamental means of interaction with the world around us. Therefore,
understanding hand poses and interaction contexts is critical for human-computer …

Mask does not matter: Anti-spoofing face authentication using mmWave without on-site registration

W Xu, W Song, J Liu, Y Liu, X Cui, Y Zheng… - Proceedings of the 28th …, 2022 - dl.acm.org
Face authentication (FA) schemes are universally adopted. However, current FA systems
are mainly camera-based and hence susceptible to face occlusion (eg, facial masks) and …

EchoSpeech: continuous silent speech recognition on minimally-obtrusive eyewear powered by acoustic sensing

R Zhang, K Li, Y Hao, Y Wang, Z Lai… - Proceedings of the …, 2023 - dl.acm.org
We present EchoSpeech, a minimally-obtrusive silent speech interface (SSI) powered by
low-power active acoustic sensing. EchoSpeech uses speakers and microphones mounted …

EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses

K Li, R Zhang, S Chen, B Chen, M Sakashita… - Proceedings of the …, 2024 - dl.acm.org
In this paper, we introduce EyeEcho, a minimally-obtrusive acoustic sensing system
designed to enable glasses to continuously monitor facial expressions. It utilizes two pairs of …

UFace: Your Smartphone Can" Hear" Your Facial Expression!

S Wang, L Zhong, Y Fu, L Chen, J Ren… - Proceedings of the ACM …, 2024 - dl.acm.org
Facial expression recognition (FER) is a crucial task for human-computer interaction and a
multitude of multimedia applications that typically call for friendly, unobtrusive, ubiquitous …

F2Key: Dynamically Converting Your Face into a Private Key Based on COTS Headphones for Reliable Voice Interaction

D Duan, Z Sun, T Ni, S Li, X Jia, W Xu, T Li - Proceedings of the 22nd …, 2024 - dl.acm.org
In this paper, we proposed F2Key, the first earable physical security system based on
commercial off-the-shelf headphones. F2Key enables impactful applications, such as …

Earse: Bringing robust speech enhancement to cots headphones

D Duan, Y Chen, W Xu, T Li - Proceedings of the ACM on Interactive …, 2024 - dl.acm.org
Speech enhancement is regarded as the key to the quality of digital communication and is
gaining increasing attention in the research field of audio processing. In this paper, we …

Attfl: A personalized federated learning framework for time-series mobile and embedded sensor data processing

JY Park, K Lee, S Lee, M Zhang, JG Ko - Proceedings of the ACM on …, 2023 - dl.acm.org
This work presents AttFL, a federated learning framework designed to continuously improve
a personalized deep neural network for efficiently analyzing time-series data generated from …

Ring-a-Pose: A Ring for Continuous Hand Pose Tracking

TC Yu, G Hu, R Zhang, H Lim, S Mahmud… - Proceedings of the …, 2024 - dl.acm.org
We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses.
Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand …

Inmyface: Inertial and mechanomyography-based sensor fusion for wearable facial activity recognition

H Bello, LAS Marin, S Suh, B Zhou, P Lukowicz - Information Fusion, 2023 - Elsevier
Recognizing facial activity is a well-understood (but non-trivial) computer vision problem.
However, reliable solutions require a camera with a good view of the face, which is often …