Enabling voice-accompanying hand-to-face gesture recognition with cross-device sensing

Z Li, C Liang, Y Wang, Y Qin, C Yu, Y Yan… - Proceedings of the …, 2023 - dl.acm.org
Gestures performed accompanying the voice are essential for voice interaction to convey
complementary semantics for interaction purposes such as wake-up state and input …

STAR: Smartphone-analogous Ty** in Augmented Reality

T Kim, A Karlson, A Gupta, T Grossman, J Wu… - Proceedings of the 36th …, 2023 - dl.acm.org
While text entry is an essential and frequent task in Augmented Reality (AR) applications,
devising an efficient and easy-to-use text entry method for AR remains an open challenge …

ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow Projection

C Liang, X Wang, Z Li, C Hsia, M Fan, C Yu… - Proceedings of the 36th …, 2023 - dl.acm.org
We present ShadowTouch, a novel sensing method to recognize the subtle hand-to-surface
touch state for independent fingers based on optical auxiliary. ShadowTouch mounts a …

Understanding In-Situ Programming for Smart Home Automation

X Liu, Y Shi, C Yu, C Gao, T Yang, C Liang… - Proceedings of the ACM …, 2023 - dl.acm.org
Programming a smart home is an iterative process in which users configure and test the
automation during the in-situ experience with IoT space. However, current end-user …

From 2d to 3d: Facilitating single-finger mid-air ty** on qwerty keyboards with probabilistic touch modeling

X Yi, C Liang, H Chen, J Song, C Yu, H Li… - Proceedings of the ACM …, 2023 - dl.acm.org
Mid-air text entry on virtual keyboards suffers from the lack of tactile feedback, which brings
challenges to both tap detection and input prediction. In this paper, we explored the …

TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision

P Streli, M Richardson, F Botros, S Ma… - Proceedings of the 37th …, 2024 - dl.acm.org
While passive surfaces offer numerous benefits for interaction in mixed reality, reliably
detecting touch input solely from head-mounted cameras has been a long-standing …

STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input

K Kin, C Wan, K Koh, A Marin, NC Camgöz… - Proceedings of the CHI …, 2024 - dl.acm.org
AR/VR devices have started to adopt hand tracking, in lieu of controllers, to support user
interaction. However, today's hand input rely primarily on one gesture: pinch. Moreover …

Understanding the Effects of Restraining Finger Coactivation in Mid-Air Ty**: from a Neuromechanical Perspective

H Zhang, X Liang, Y Lei, Y Chen, Z He… - Proceedings of the 37th …, 2024 - dl.acm.org
Ty** in mid-air is often perceived as intuitive yet presents challenges due to finger
coactivation, a neuromechanical phenomenon that involves involuntary finger movements …

MouseRing: Always-available Touchpad Interaction with IMU Rings

X Shen, C Yu, X Wang, C Liang, H Chen… - Proceedings of the CHI …, 2024 - dl.acm.org
Tracking fine-grained finger movements with IMUs for continuous 2D-cursor control poses
significant challenges due to limited sensing capabilities. Our findings suggest that finger …

PmTrack: Enabling Personalized mmWave-based Human Tracking

H Liu, X Liu, X **e, X Tong, K Li - Proceedings of the ACM on Interactive …, 2024 - dl.acm.org
The difficulty in obtaining targets' identity poses a significant obstacle to the pursuit of
personalized and customized millimeter-wave (mmWave) sensing. Existing solutions that …