Realitytalk: Real-time speech-driven augmented presentation for ar live storytelling

J Liao, A Karim, SS Jadon, RH Kazi… - Proceedings of the 35th …, 2022 - dl.acm.org
We present RealityTalk, a system that augments real-time live presentations with speech-
driven interactive virtual elements. Augmented presentations leverage embedded visuals …

Haptic links: Bimanual haptics for virtual reality using variable stiffness actuation

E Strasnick, C Holz, E Ofek, M Sinclair… - Proceedings of the 2018 …, 2018 - dl.acm.org
We present Haptic Links, electro-mechanically actuated physical connections capable of
rendering variable stiffness between two commodity handheld virtual reality (VR) controllers …

Magicalhands: Mid-air hand gestures for animating in vr

R Arora, RH Kazi, DM Kaufman, W Li… - Proceedings of the 32nd …, 2019 - dl.acm.org
We explore the use of hand gestures for authoring animations in virtual reality (VR). We first
perform a gesture elicitation study to understand user preferences for a spatiotemporal, bare …

Interactive body-driven graphics for augmented video performance

N Saquib, RH Kazi, LY Wei, W Li - … of the 2019 CHI Conference on …, 2019 - dl.acm.org
We present a system that augments live presentation videos with interactive graphics to
create a powerful and expressive storytelling environment. Using our system, the presenter …

Commonsense Knowledge-Driven Joint Reasoning Approach for Object Retrieval in Virtual Reality

H Jiang, D Weng, X Dongye, L Luo… - ACM Transactions on …, 2023 - dl.acm.org
National Key Laboratory of General Artificial Intelligence, Bei**g Institute for General
Artificial Intelligence (BIGAI), China Retrieving out-of-reach objects is a crucial task in virtual …

Virtualgrasp: Leveraging experience of interacting with physical objects to facilitate digital object retrieval

Y Yan, C Yu, X Ma, X Yi, K Sun, Y Shi - … of the 2018 Chi conference on …, 2018 - dl.acm.org
We propose VirtualGrasp, a novel gestural approach to retrieve virtual objects in virtual
reality. Using VirtualGrasp, a user retrieves an object by performing a barehanded gesture …

Sensorimotor realities: Formalizing ability-mediating design for computer-mediated reality environments

RD Vatavu - 2022 IEEE International Symposium on Mixed and …, 2022 - ieeexplore.ieee.org
We introduce “Sensorimotor Realities,” a new concept in the XR landscape and
corresponding technology-agnostic framework for computer-mediated perception and motor …

Self-transforming controllers for virtual reality first person shooters

A Krekhov, K Emmerich, P Bergmann… - Proceedings of the …, 2017 - dl.acm.org
Immersive technologies push the boundaries of virtual reality games. In particular, input
controllers play an important role for such a player experience. With regard to first-person …

Design of and subjective response to on-body input for people with visual impairments

U Oh, L Findlater - Proceedings of the 16th international ACM …, 2014 - dl.acm.org
For users with visual impairments, who do not necessarily need the visual display of a
mobile device, non-visual on-body interaction (eg, Imaginary Interfaces) could provide …

Digital vibrons: understanding users' perceptions of interacting with invisible, zero-weight matter

RD Vatavu, A Mossel, C Schönauer - Proceedings of the 18th …, 2016 - dl.acm.org
We investigate in this work users' perceptions of interacting with invisible, zero-weight digital
matter for smart mobile scenarios. To this end, we introduce the concept of a digital vibron as …