Prompting visual-language models for efficient video understanding
Image-based visual-language (I-VL) pre-training has shown great success for learning joint
visual-textual representations from large-scale web data, revealing remarkable ability for …
visual-textual representations from large-scale web data, revealing remarkable ability for …
Open-vocabulary semantic segmentation via attribute decomposition-aggregation
Open-vocabulary semantic segmentation is a challenging task that requires segmenting
novel object categories at inference time. Recent works explore vision-language pre-training …
novel object categories at inference time. Recent works explore vision-language pre-training …
Divide and conquer for single-frame temporal action localization
Single-frame temporal action localization (STAL) aims to localize actions in untrimmed
videos with only one timestamp annotation for each action instance. Existing methods adopt …
videos with only one timestamp annotation for each action instance. Existing methods adopt …
Distilling vision-language pre-training to collaborate with weakly-supervised temporal action localization
Weakly-supervised temporal action localization (WTAL) learns to detect and classify action
instances with only category labels. Most methods widely adopt the off-the-shelf …
instances with only category labels. Most methods widely adopt the off-the-shelf …
Turbo: Informativity-driven acceleration plug-in for vision-language large models
Abstract Vision-Language Large Models (VLMs) recently become primary backbone of AI,
due to the impressive performance. However, their expensive computation costs, ie …
due to the impressive performance. However, their expensive computation costs, ie …
DDG-Net: Discriminability-Driven Graph Network for Weakly-supervised Temporal Action Localization
Weakly-supervised temporal action localization (WTAL) is a practical yet challenging task.
Due to large-scale datasets, most existing methods use a network pretrained in other …
Due to large-scale datasets, most existing methods use a network pretrained in other …
Audio-Visual Segmentation via Unlabeled Frame Exploitation
Audio-visual segmentation (AVS) aims to segment the sounding objects in video frames.
Although great progress has been witnessed we experimentally reveal that current methods …
Although great progress has been witnessed we experimentally reveal that current methods …
Temporal action localization in the deep learning era: A survey
The temporal action localization research aims to discover action instances from untrimmed
videos, representing a fundamental step in the field of intelligent video understanding. With …
videos, representing a fundamental step in the field of intelligent video understanding. With …
Multi-modal prompting for low-shot temporal action localization
In this paper, we consider the problem of temporal action localization under low-shot (zero-
shot & few-shot) scenario, with the goal of detecting and classifying the action instances from …
shot & few-shot) scenario, with the goal of detecting and classifying the action instances from …
Multi-modal prototypes for open-set semantic segmentation
In semantic segmentation, adapting a visual system to novel object categories at inference
time has always been both valuable and challenging. To enable such generalization …
time has always been both valuable and challenging. To enable such generalization …