With the success of large language models (LLMs) integrating the vision model into LLMs to
build vision-language foundation models has gained much more interest recently. However …

Tokenizer, serving as a translator to map the intricate visual data into a compact latent
space, lies at the core of visual generative models. Based on the finding that existing …

With the burgeoning growth of online video platforms and the escalating volume of video
content, the demand for proficient video understanding tools has intensified markedly. Given …

In this paper, we explore the visual representations produced from a pre-trained text-to-
video (T2V) diffusion model for video understanding tasks. We hypothesize that the latent …

Traffic video description and analysis have received much attention recently due to the
growing demand for efficient and reliable urban surveillance systems. Most existing methods …

Text-guided video prediction (TVP) involves predicting the motion of future frames from the
initial frame according to an instruction, which has wide applications in virtual reality …

Visual Object Tracking (VOT) aims to estimate the positions of target objects in a video
sequence, which is an important vision task with various real-world applications. Depending …

Large language models (LLMs) have revolutionized video-based computer vision
applications, including action recognition, anomaly detection, and video summarization …

Sports video captioning in real application scenarios requires both entities and specific
scenes. However, it is difficult to extract this fine-grained information solely from the video …

Despite the recent emergence of video captioning models, how to generate the text
description with specific entity names and fine-grained actions is far from being solved …