Echowrist: Continuous hand pose tracking and hand-object interaction recognition using low-power active acoustic sensing on a wristband

CJ Lee, R Zhang, D Agarwal, TC Yu, V Gunda… - Proceedings of the …, 2024 - dl.acm.org
Our hands serve as a fundamental means of interaction with the world around us. Therefore,
understanding hand poses and interaction contexts is critical for human-computer …

Sensing beyond itself: Multi-functional use of ubiquitous signals towards wearable applications

Z Wang, J Li, Y **, J Wang, F Yang, G Li, X Ni… - Digital Signal …, 2021 - Elsevier
Wearable technologies provide a non-invasive way to monitor user's activity, identity, and
health in real-time, which have attracted tremendous interests from both academia and …

TapID: Rapid touch interaction in virtual reality using wearable sensing

M Meier, P Streli, A Fender… - 2021 IEEE Virtual Reality …, 2021 - ieeexplore.ieee.org
Current Virtual Reality systems typically use cameras to capture user input from controllers
or free-hand mid-air interaction. In this paper, we argue that this is a key impediment to …

Enabling voice-accompanying hand-to-face gesture recognition with cross-device sensing

Z Li, C Liang, Y Wang, Y Qin, C Yu, Y Yan… - Proceedings of the …, 2023 - dl.acm.org
Gestures performed accompanying the voice are essential for voice interaction to convey
complementary semantics for interaction purposes such as wake-up state and input …

SAWSense: Using surface acoustic waves for surface-bound event recognition

Y Iravantchi, Y Zhao, K Kin, AP Sample - … of the 2023 CHI Conference on …, 2023 - dl.acm.org
Enabling computing systems to understand user interactions with everyday surfaces and
objects can drive a wide range of applications. However, existing vibration-based sensors …

TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking Only

C Dupré, C Appert, S Rey, H Saidi… - Proceedings of the 2024 …, 2024 - dl.acm.org
TriPad enables opportunistic touch interaction in Augmented Reality using hand tracking
only. Users declare the surface they want to appropriate with a simple hand tap gesture …

MAF: Exploring mobile acoustic field for hand-to-face gesture interactions

Y Yang, T Chen, Y Huang, X Guo… - Proceedings of the 2024 …, 2024 - dl.acm.org
We present MAF, a novel acoustic sensing approach that leverages the commodity
hardware in bone conduction earphones for hand-to-face gesture interactions. Briefly, by …

Structured Light Speckle: Joint Ego-Centric Depth Estimation and Low-Latency Contact Detection via Remote Vibrometry

P Streli, J Jiang, J Rossie, C Holz - Proceedings of the 36th Annual ACM …, 2023 - dl.acm.org
Despite advancements in egocentric hand tracking using head-mounted cameras, contact
detection with real-world objects remains challenging, particularly for the quick motions often …

Sensurfaces: A novel approach for embedded touch sensing on everyday surfaces

B Parilusyan, M Teyssier, V Martinez-Missir… - Proceedings of the …, 2022 - dl.acm.org
Ubiquitous touch sensing surfaces are largely influenced by touchscreens' look and feel and
fail to express the physical richness of existing surrounding materials. We introduce …

TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision

P Streli, M Richardson, F Botros, S Ma… - Proceedings of the 37th …, 2024 - dl.acm.org
While passive surfaces offer numerous benefits for interaction in mixed reality, reliably
detecting touch input solely from head-mounted cameras has been a long-standing …