Accurate and consistent evaluation is crucial for decision-making across numerous fields,
yet it remains a challenging task due to inherent subjectivity, variability, and scale. Large …

With the success of 2D diffusion models, 2D AIGC content has already transformed our lives.
Recently, this success has been extended to 3D AIGC, with state-of-the-art methods …

Leading AI developers and startups are increasingly deploying agentic AI systems that can
plan and execute complex tasks with limited human involvement. However, there is currently …

Autonomous agents powered by large language models (LLMs) show promising potential in
assistive tasks across various domains, including mobile device control. As these agents …

We introduce a new benchmark for assessing AI models' capabilities and risks in automated
software exploitation, focusing on their ability to detect and exploit vulnerabilities in real …

Large Language Model (LLM)-based Multi-agent Systems (MAS) have demonstrated
remarkable capabilities in various complex tasks, ranging from collaborative problem …

The emergent phenomena of large foundation models have revolutionized natural language
processing. However, evaluating these models presents significant challenges due to their …

Multimodal foundation models (MFMs) represent a significant advancement in artificial
intelligence, combining diverse data modalities to enhance learning and understanding …

The rapid development of large reasoning models, such as OpenAI-o3 and DeepSeek-R1,
has led to significant improvements in complex reasoning over non-reasoning large …

A trained Large Language Model (LLM) contains much of human knowledge. Yet, it is
difficult to gauge the extent or accuracy of that knowledge, as LLMs do not always``know …