Contrastive pre-training of image-text foundation models such as CLIP demonstrated
excellent zero-shot performance and improved robustness on a wide range of downstream …

In this work, we survey recent studies on masked image modeling (MIM), an approach that
emerged as a powerful self-supervised learning technique in computer vision. The MIM task …

Recent advances in Large Language Models (LLMs) have catalyzed the development of
Large Multimodal Models (LMMs). However, existing research primarily focuses on tuning …

Despite recent advancements in masked skeleton modeling and visual-language pre-
training, no method has yet been proposed to explore capturing and utilizing the rich …

Visual storytelling is a multi-modal generation task aiming to generate a coherent story for a
sequence of images. Previous visual storytelling models utilize task-beneficial non-visual …

This paper demonstrates a self-supervised approach for learning semantic video
representations. Recent vision studies show that a masking strategy for vision and natural …

Contrastive Language-Image Pre-training (CLIP) has attracted a surge of attention for its
superior zero-shot performance and excellent transferability to downstream tasks. However …