ChatIoT: Zero-code Generation of Trigger-action Based IoT Programs

Y Gao, K **ao, F Li, W Xu, J Huang… - Proceedings of the ACM on …, 2024 - dl.acm.org
Trigger-Action Program (TAP) is a simple but powerful format to realize intelligent IoT
applications, especially in home automation scenarios. Existing trace-driven approaches …

ContextCam: Bridging Context Awareness with Creative Human-AI Image Co-Creation

X Fan, Z Wu, C Yu, F Rao, W Shi, T Tu - Proceedings of the CHI …, 2024 - dl.acm.org
The rapid advancement of AI-generated content (AIGC) promises to transform various
aspects of human life significantly. This work particularly focuses on the potential of AIGC to …

G-VOILA: Gaze-Facilitated Information Querying in Daily Scenarios

Z Wang, Y Shi, Y Wang, Y Yao, K Yan, Y Wang… - Proceedings of the …, 2024 - dl.acm.org
Modern information querying systems are progressively incorporating multimodal inputs like
vision and audio. However, the integration of gaze---a modality deeply linked to user intent …

Who Should Hold Control? Rethinking Empowerment in Home Automation among Cohabitants through the Lens of Co-Design

X Xue, X Li, B Jia, J Du, X Fu - Proceedings of the CHI Conference on …, 2024 - dl.acm.org
Recent HCI research has highlighted home automation's potential in providing residents
with technology-enhanced domestic autonomy. However, in the cohabitation context, the …

[PDF][PDF] Understanding Creators Mental Models in Immersive Virtual Reality Programming

M Andrao, L Zhang, L Elvira-Martín… - Proceedings of the …, 2024 - ceur-ws.org
Empowering users-independently of their programming expertise-to create dynamic
elements and scenes of virtual environments directly while immersed in them has gained …

Toolkit Design for Building Camera Sensor-Driven DIY Smart Homes

S Yun, Y Lim - Companion of the 2024 on ACM International Joint …, 2024 - dl.acm.org
In a do-it-yourself (DIY) smart home, users can implement desired features by combining
sensors and actuators. Specifically, effective sensing of home situations is crucial for …

A Case Study Exploring the Applicability of Heuristic Evaluation in Smart Home Systems

M Chen, S He, X Fu - Extended Abstracts of the CHI Conference on …, 2024 - dl.acm.org
Smart home systems, integrating multiple devices and interaction methods, give rise to
complex usability challenges. While heuristic evaluation has been a preferred method for …

[PDF][PDF] LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects

W Liu, L Liu, Y Guo, H **ao, W Lin, Y Chai, S Ren… - 2025 - preprints.org
With the rapid rise of large language models (LLMs), phone automation has undergone
transformative changes. This paper systematically reviews LLM-driven phone GUI agents …

Design of an Energy-Saving System for Smart Home Decoration Based on Situational Awareness

L Tang - International Journal of e-Collaboration (IJeC), 2024 - igi-global.com
This article analyzes the specific energy-saving requirements for smart home decoration in
the current market to determine the overall plan of the entire smart home decoration energy …

[PDF][PDF] Transforming Everyday Objects into IoT Control Interfaces: Design and Evaluation of the'e-Rings' System

C Kim - Archives of Design Research, 2024 - aodr.org
Background The concept of a smart environment has been a topic of discussion for decades,
but recent advancements in Internet of Things (IoT) technology have made it more …