Webui: A dataset for enhancing visual ui understanding with web semantics
Modeling user interfaces (UIs) from visual information allows systems to make inferences
about the functionality and semantics needed to support use cases in accessibility, app …
about the functionality and semantics needed to support use cases in accessibility, app …
Toward interactive bug reporting for (android app) end-users
Many software bugs are reported manually, particularly bugs that manifest themselves
visually in the user interface. End-users typically report these bugs via app reviewing …
visually in the user interface. End-users typically report these bugs via app reviewing …
Combining Language and App UI Analysis for the Automated Assessment of Bug Reproduction Steps
Bug reports are essential for developers to confirm software problems, investigate their
causes, and validate fixes. Unfortunately, reports often miss important information or are …
causes, and validate fixes. Unfortunately, reports often miss important information or are …
Unveiling ChatGPT's Usage in Open Source Projects: A Mining-based Study
Large Language Models (LLMs) have gained significant attention in the software
engineering community. Nowadays developers have the possibility to exploit these models …
engineering community. Nowadays developers have the possibility to exploit these models …
Toward the automated localization of buggy mobile app uis from bug descriptions
Bug report management is a costly software maintenance process comprised of several
challenging tasks. Given the UI-driven nature of mobile apps, bugs typically manifest …
challenging tasks. Given the UI-driven nature of mobile apps, bugs typically manifest …
MotorEase: Automated detection of motor impairment accessibility issues in mobile app UIs
Recent research has begun to examine the potential of automatically finding and fixing
accessibility issues that manifest in software. However, while recent work makes important …
accessibility issues that manifest in software. However, while recent work makes important …
On Using GUI Interaction Data to Improve Text Retrieval-based Bug Localization
One of the most important tasks related to managing bug reports is localizing the fault so that
a fix can be applied. As such, prior work has aimed to automate this task of bug localization …
a fix can be applied. As such, prior work has aimed to automate this task of bug localization …
Vision-Based Mobile App GUI Testing: A Survey
Graphical User Interface (GUI) has become one of the most significant parts of mobile
applications (apps). It is a direct bridge between mobile apps and end users, which directly …
applications (apps). It is a direct bridge between mobile apps and end users, which directly …
AURORA: Navigating UI Tarpits via Automated Neural Screen Understanding
SA Khan, W Wang, Y Ren, B Zhu, J Shi… - arxiv preprint arxiv …, 2024 - arxiv.org
Nearly a decade of research in software engineering has focused on automating mobile app
testing to help engineers in overcoming the unique challenges associated with the software …
testing to help engineers in overcoming the unique challenges associated with the software …
SmartRecorder: An IMU-based Video Tutorial Creation by Demonstration System for Smartphone Interaction Tasks
This work focuses on an active topic in the HCI community, namely tutorial creation by
demonstration. We present a novel tool named SmartRecorder that facilitates people …
demonstration. We present a novel tool named SmartRecorder that facilitates people …