A map** review of real-time movement sonification systems for movement rehabilitation

TH Nown, P Upadhyay, A Kerr… - IEEE Reviews in …, 2022 - ieeexplore.ieee.org
Movement sonification is emerging as a useful tool for rehabilitation, with increasing
evidence in support of its use. To create such a system requires component considerations …

Pseudo-haptics: Leveraging cross-modal perception in virtual environments

K Collins, B Kapralos - The Senses and Society, 2019 - Taylor & Francis
This paper is an introduction to pseudo-haptics; that is, the use of touch-based illusions
created by cross-modal perceptual interactions. Many studies have shown that it is possible …

Study of multimodal interfaces and the improvements on teleoperation

E Triantafyllidis, C Mcgreavy, J Gu, Z Li - IEEE Access, 2020 - ieeexplore.ieee.org
Research in multimodal interfaces aims to provide immersive solutions and to increase
overall human performance. A promising direction is to combine auditory, visual and haptic …

Feeling colours: Crossmodal correspondences between tangible 3d objects, colours and emotions

A Lin, M Scheller, F Feng, MJ Proulx… - Proceedings of the 2021 …, 2021 - dl.acm.org
With increasing interest in multisensory experiences in HCI there is a need to consider the
potential impact of crossmodal correspondences (CCs) between sensory modalities on …

The impact of data sonification in virtual reality robot teleoperation

P Bremner, TJ Mitchell, V McIntosh - Frontiers in Virtual Reality, 2022 - frontiersin.org
Virtual Reality (VR) is being increasingly used to provide a more intuitive and embodied
approach to robotic teleoperation, giving operators a sense of presence in the remote …

Combining multimodal technology-mediated and peer feedback: effects on second language (L2) learners' complexity, accuracy, and fluency (CAF) in writing

P Imsa-ard, JS Barrot - Computer Assisted Language Learning, 2024 - Taylor & Francis
While research on the impact of multimodal technology-mediated feedback on second
language (L2) writing is expanding, many studies predominantly focus on overall writing …

Body Transformation: An Experiential Quality of Sensory Feedback Wearables for Altering Body Perception

L Turmo Vidal, A Tajadura-Jiménez… - Proceedings of the …, 2024 - dl.acm.org
Body perception has a significant impact on people's motor, emotional, and social
functioning. We evaluated the potential of four different existing wearable prototypes, which …

Pushed by Sound: Effects of Sound and Movement Direction on Body Perception, Experience Quality, and Exercise Support

A Singh, M Hrobat, S Gui, N Bianchi-Berthouze… - ACM Transactions on …, 2024 - dl.acm.org
Wearables integrating movement sonification can support body-perception changes and
relatedly physical activity; yet, we lack design principles for such sonifications. Through two …

[HTML][HTML] Bi-Directional Gaze-Based Communication: A Review

BR Severitt, N Castner, S Wahl - Multimodal Technologies and …, 2024 - mdpi.com
Bi-directional gaze-based communication offers an intuitive and natural way for users to
interact with systems. This approach utilizes the user's gaze not only to communicate intent …

Diverse sounds: Enabling inclusive sonic interaction

E Frid - 2019 - diva-portal.org
This compilation thesis collects a series of publications on designing sonic interactions for
diversity and inclusion. The presented papers focus on case studies in which musical …