The development of Artificial Intelligence Generated Content (AIGC) has been facilitated by
advancements in model algorithms, scalable foundation model architectures, and the …

The remarkable performance of Multimodal Large Language Models (MLLMs) has
demonstrated their proficient understanding capabilities in handling various visual tasks …

In this paper, we introduce the Generalist Virtual Agent (GVA), an autonomous entity
engineered to function across diverse digital platforms and environments, assisting users by …

In recent times, Vision-Language Models (VLMs) have been trained under two predominant
paradigms. Generative training has enabled Multimodal Large Language Models (MLLMs) …

Visual programming prompts LLMs (large language mod-els) to generate executable code
for visual tasks like visual question answering (VQA). Prompt-based methods are difficult to …

Instruction tuning fine-tunes pre-trained Multi-modal Large Language Models (MLLMs) to
handle real-world tasks. However, the rapid expansion of visual instruction datasets …

Visual programs are executable code generated by large language models to address
visual reasoning problems. They decompose complex questions into multiple reasoning …

Visual Programming has emerged as an alternative to end-to-end black-box visual
reasoning models. This type of methods leverage Large Language Models (LLMs) to …

Digital agents are increasingly employed to automate tasks in interactive digital
environments such as web pages, software applications, and operating systems. While text …