Screen2vec: Semantic embedding of gui screens and gui components

TJJ Li, L Popowski, T Mitchell, BA Myers - Proceedings of the 2021 CHI …, 2021 - dl.acm.org
Representing the semantics of GUI screens and components is crucial to data-driven
computational methods for modeling user-GUI interactions and mining GUI designs. Existing …

Interactive task learning from GUI-grounded natural language instructions and demonstrations

TJJ Li, T Mitchell, B Myers - … of the 58th Annual Meeting of the …, 2020 - aclanthology.org
We show SUGILITE, an intelligent task automation agent that can learn new tasks and
relevant associated concepts interactively from the user's natural language instructions and …

To reuse or not to reuse? A framework and system for evaluating summarized knowledge

MX Liu, A Kittur, BA Myers - Proceedings of the ACM on Human …, 2021 - dl.acm.org
As the amount of information online continues to grow, a correspondingly important
opportunity is for individuals to reuse knowledge which has been summarized by others …

New perspectives for cyber security in software development: when end-user development meets artificial intelligence

V Santa Barletta, F Cassano, A Pagano… - … on Innovation and …, 2022 - ieeexplore.ieee.org
Current research faces a" war" between Human-Computer Interaction and Artificial
Intelligence. Despite the shared goal to support the user in his/her choices, researchers …