Caption royale: Exploring the design space of affective captions from the perspective of deaf and hard-of-hearing individuals

C de Lacerda Pataca, S Hassan, N Tinker… - Proceedings of the …, 2024 - dl.acm.org
Affective captions employ visual typographic modulations to convey a speaker's emotions,
improving speech accessibility for Deaf and Hard-of-Hearing (dhh) individuals. However, the …

Emoballoon-conveying emotional arousal in text chats with speech balloons

T Aoki, R Chujo, K Matsui, S Choi… - Proceedings of the 2022 …, 2022 - dl.acm.org
Text chat applications are an integral part of daily social and professional communication.
However, messages sent over text chat applications do not convey vocal or nonverbal …

Visualization of speech prosody and emotion in captions: Accessibility for deaf and hard-of-hearing users

C de Lacerda Pataca, M Watkins, R Peiris… - Proceedings of the …, 2023 - dl.acm.org
Speech is expressive in ways that caption text does not capture, with emotion or emphasis
information not conveyed. We interviewed eight Deaf and Hard-of-Hearing (dhh) individuals …

AniBalloons: Animated chat balloons as affective augmentation for social messaging and chatbot interaction

P An, C Zhang, H Gao, Z Zhou, Y **ao… - International Journal of …, 2025 - Elsevier
Despite being prominent and ubiquitous, message-based communication is limited in
nonverbally conveying emotions. Besides emoticons or stickers, messaging users continue …

A Pilot Study on Clinician-AI Collaboration in Diagnosing Depression from Speech

K Feng, T Chaspari - arxiv preprint arxiv:2410.18297, 2024 - arxiv.org
This study investigates clinicians' perceptions and attitudes toward an assistive artificial
intelligence (AI) system that employs a speech-based explainable ML algorithm for detecting …

EmoWear: Exploring emotional teasers for voice message interaction on smartwatches

P An, JS Zhu, Z Zhang, Y Yin, Q Ma, C Yan… - Proceedings of the …, 2024 - dl.acm.org
Voice messages, by nature, prevent users from gauging the emotional tone without fully
diving into the audio content. This hinders the shared emotional experience at the pre …

Troi: Towards understanding users perspectives to mobile automatic emotion recognition system in their natural setting

V Dissanayake, V Tang, DS Elvitigala, E Wen… - Proceedings of the …, 2022 - dl.acm.org
Emotional Self-Awareness (ESA) plays a vital role in physical and mental well-being. Recent
advancements in artificial intelligence technologies have shown promising emotion …

Affective Typography: The Effect of AI-Driven Font Design on Empathetic Story Reading

JJ Shen, K **, A Zhang, C Breazeal… - Extended Abstracts of the …, 2023 - dl.acm.org
When people listen to stories, the words are colored with emotions conveyed through
prosodic features beyond the text alone. Visual font design provides an opportunity to …

The Evolution of Emojis for Sharing Emotions: A Systematic Review of the HCI Literature

C Chiang, D Gomez-Zara - arxiv preprint arxiv:2409.17322, 2024 - arxiv.org
With the prevalence of instant messaging and social media platforms, emojis have become
important artifacts for expressing emotions and feelings in our daily lives. We ask how HCI …

Emote: An interactive online tool for designing real-time emotional ar visualizations

S Şemsioğlu, P Karaturhan, AE Yantaç - 13th Augmented Human …, 2022 - dl.acm.org
In a future when augmented vision becomes a part of our daily lives, some might want or
need to highlight their emotions by visuals on or around their bodies like wearing a …