Dynamic planning for llm-based graphical user interface automation

S Zhang, Z Zhang, K Chen, X Ma, M Yang… - arxiv preprint arxiv …, 2024 - arxiv.org
The advent of large language models (LLMs) has spurred considerable interest in
advancing autonomous LLMs-based agents, particularly in intriguing applications within …

AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation

H Wen, S Tian, B Pavlov, W Du, Y Li, G Chang… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) have brought exciting new advances to mobile UI agents, a
long-standing research field that aims to complete arbitrary natural language tasks through …

AEIA-MN: Evaluating the Robustness of Multimodal LLM-Powered Mobile Agents Against Active Environmental Injection Attacks

Y Chen, X Hu, K Yin, J Li, S Zhang - arxiv preprint arxiv:2502.13053, 2025 - arxiv.org
As researchers continuously optimize AI agents to perform tasks more effectively within
operating systems, they often neglect to address the critical need for enabling these agents …

[PDF][PDF] Os agents: A survey on mllm-based agents for general computing devices use

X Hu, T **ong, B Yi, Z Wei, R **ao, Y Chen, J Ye, M Tao… - 2024 - preprints.org
The dream to create AI assistants as capable and versatile as the fictional JARVIS from Iron
Man has long captivated imaginations. With the evolution of (multimodal) large language …

[PDF][PDF] A Comprehensive Solution for the Safety and Controllability of Artificial Superintelligence

W Wang - 2024 - preprints.org
As artificial intelligence technology rapidly advances, it is likely to implement Artificial
General Intelligence (AGI) and Artificial Superintelligence (ASI) in the future. The highly …