Multimodal Direct Manipulation in Video Conferencing: Challenges and Opportunities

JU Davis, P Asente, XD Yang - Proceedings of the 2023 ACM Designing …, 2023 - dl.acm.org
Tools supporting immersive live video conferencing (VC) have gained popularity recently
across diverse application domains. A core component of the experience is augmenting …

PANDALens: Towards AI-Assisted In-Context Writing on OHMD During Travels

R Cai, N Janaka, Y Chen, L Wang, S Zhao… - Proceedings of the CHI …, 2024 - dl.acm.org
While effective for recording and sharing experiences, traditional in-context writing tools are
relatively passive and unintelligent, serving more like instruments rather than companions …

Think-aloud computing: Supporting rich and low-effort knowledge capture

R Krosnick, F Anderson, J Matejka, S Oney… - Proceedings of the …, 2021 - dl.acm.org
When users complete tasks on the computer, the knowledge they leverage and their intent is
often lost because it is tedious or challenging to capture. This makes it harder to understand …

Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations

Y Kim, SJ Lee, C Donahue - arxiv preprint arxiv:2412.18940, 2024 - arxiv.org
Songwriting is often driven by multimodal inspirations, such as imagery, narratives, or
existing music, yet songwriters remain unsupported by current music AI systems in …

Demonstrating PANDALens: Enhancing Daily Activity Documentation with AI-assisted In-Context Writing on OHMD

N Janaka, R Cai, S Zhao, D Hsu - … Abstracts of the CHI Conference on …, 2024 - dl.acm.org
We introduce PANDALens, a Proactive AI Narrative Documentation Assistant built on an
Optical See-Through Head-Mounted Display that transforms the in-context writing tool into …

[PDF][PDF] ADVANCING OMNIMODALITY: EXPANDING HUMAN CREATIVITY THROUGH ADAPTABLE AND ACCESSIBLE MULTIMODAL COMPUTING SYSTEMS

JU Davis - 2024 - digitalcommons.dartmouth.edu
ADVANCING OMNIMODALITY: EXPANDING HUMAN CREATIVITY THROUGH
ADAPTABLE AND ACCESSIBLE MULTIMODAL COMPUTING SYSTEMS Page 1 …