TapID: Rapid touch interaction in virtual reality using wearable sensing
Current Virtual Reality systems typically use cameras to capture user input from controllers
or free-hand mid-air interaction. In this paper, we argue that this is a key impediment to …
or free-hand mid-air interaction. In this paper, we argue that this is a key impediment to …
Sensing beyond itself: Multi-functional use of ubiquitous signals towards wearable applications
Wearable technologies provide a non-invasive way to monitor user's activity, identity, and
health in real-time, which have attracted tremendous interests from both academia and …
health in real-time, which have attracted tremendous interests from both academia and …
Echowrist: Continuous hand pose tracking and hand-object interaction recognition using low-power active acoustic sensing on a wristband
Our hands serve as a fundamental means of interaction with the world around us. Therefore,
understanding hand poses and interaction contexts is critical for human-computer …
understanding hand poses and interaction contexts is critical for human-computer …
Enabling voice-accompanying hand-to-face gesture recognition with cross-device sensing
Gestures performed accompanying the voice are essential for voice interaction to convey
complementary semantics for interaction purposes such as wake-up state and input …
complementary semantics for interaction purposes such as wake-up state and input …
SAWSense: Using surface acoustic waves for surface-bound event recognition
Enabling computing systems to understand user interactions with everyday surfaces and
objects can drive a wide range of applications. However, existing vibration-based sensors …
objects can drive a wide range of applications. However, existing vibration-based sensors …
TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision
While passive surfaces offer numerous benefits for interaction in mixed reality, reliably
detecting touch input solely from head-mounted cameras has been a long-standing …
detecting touch input solely from head-mounted cameras has been a long-standing …
Sensurfaces: A novel approach for embedded touch sensing on everyday surfaces
Ubiquitous touch sensing surfaces are largely influenced by touchscreens' look and feel and
fail to express the physical richness of existing surrounding materials. We introduce …
fail to express the physical richness of existing surrounding materials. We introduce …
MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture Interactions
We present MAF, a novel acoustic sensing approach that leverages the commodity
hardware in bone conduction earphones for hand-to-face gesture interactions. Briefly, by …
hardware in bone conduction earphones for hand-to-face gesture interactions. Briefly, by …
EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision
Estimating touch contact and pressure in egocentric vision is a central task for downstream
applications in Augmented Reality, Virtual Reality, as well as many robotic applications …
applications in Augmented Reality, Virtual Reality, as well as many robotic applications …
Structured Light Speckle: Joint Ego-Centric Depth Estimation and Low-Latency Contact Detection via Remote Vibrometry
Despite advancements in egocentric hand tracking using head-mounted cameras, contact
detection with real-world objects remains challenging, particularly for the quick motions often …
detection with real-world objects remains challenging, particularly for the quick motions often …