Enabling voice-accompanying hand-to-face gesture recognition with cross-device sensing
Gestures performed accompanying the voice are essential for voice interaction to convey
complementary semantics for interaction purposes such as wake-up state and input …
complementary semantics for interaction purposes such as wake-up state and input …
STAR: Smartphone-analogous Ty** in Augmented Reality
While text entry is an essential and frequent task in Augmented Reality (AR) applications,
devising an efficient and easy-to-use text entry method for AR remains an open challenge …
devising an efficient and easy-to-use text entry method for AR remains an open challenge …
ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow Projection
We present ShadowTouch, a novel sensing method to recognize the subtle hand-to-surface
touch state for independent fingers based on optical auxiliary. ShadowTouch mounts a …
touch state for independent fingers based on optical auxiliary. ShadowTouch mounts a …
Understanding In-Situ Programming for Smart Home Automation
Programming a smart home is an iterative process in which users configure and test the
automation during the in-situ experience with IoT space. However, current end-user …
automation during the in-situ experience with IoT space. However, current end-user …
From 2d to 3d: Facilitating single-finger mid-air ty** on qwerty keyboards with probabilistic touch modeling
X Yi, C Liang, H Chen, J Song, C Yu, H Li… - Proceedings of the ACM …, 2023 - dl.acm.org
Mid-air text entry on virtual keyboards suffers from the lack of tactile feedback, which brings
challenges to both tap detection and input prediction. In this paper, we explored the …
challenges to both tap detection and input prediction. In this paper, we explored the …
TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision
While passive surfaces offer numerous benefits for interaction in mixed reality, reliably
detecting touch input solely from head-mounted cameras has been a long-standing …
detecting touch input solely from head-mounted cameras has been a long-standing …
STMG: A Machine Learning Microgesture Recognition System for Supporting Thumb-Based VR/AR Input
AR/VR devices have started to adopt hand tracking, in lieu of controllers, to support user
interaction. However, today's hand input rely primarily on one gesture: pinch. Moreover …
interaction. However, today's hand input rely primarily on one gesture: pinch. Moreover …
Understanding the Effects of Restraining Finger Coactivation in Mid-Air Ty**: from a Neuromechanical Perspective
Ty** in mid-air is often perceived as intuitive yet presents challenges due to finger
coactivation, a neuromechanical phenomenon that involves involuntary finger movements …
coactivation, a neuromechanical phenomenon that involves involuntary finger movements …
MouseRing: Always-available Touchpad Interaction with IMU Rings
X Shen, C Yu, X Wang, C Liang, H Chen… - Proceedings of the CHI …, 2024 - dl.acm.org
Tracking fine-grained finger movements with IMUs for continuous 2D-cursor control poses
significant challenges due to limited sensing capabilities. Our findings suggest that finger …
significant challenges due to limited sensing capabilities. Our findings suggest that finger …
PmTrack: Enabling Personalized mmWave-based Human Tracking
The difficulty in obtaining targets' identity poses a significant obstacle to the pursuit of
personalized and customized millimeter-wave (mmWave) sensing. Existing solutions that …
personalized and customized millimeter-wave (mmWave) sensing. Existing solutions that …