Transformer-based visual segmentation: A survey

X Li, H Ding, H Yuan, W Zhang, J Pang… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Visual segmentation seeks to partition images, video frames, or point clouds into multiple
segments or groups. This technique has numerous real-world applications, such as …

[HTML][HTML] Coarse-to-fine video instance segmentation with factorized conditional appearance flows

Z Qin, X Lu, X Nie, D Liu, Y Yin, W Wang - IEEE/CAA Journal of …, 2023 - ieee-jas.net
We introduce a novel method using a new generative model that automatically learns
effective representations of the target and background appearance to detect, segment and …

Instances as queries

Y Fang, S Yang, X Wang, Y Li, C Fang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present QueryInst, a new perspective for instance segmentation. QueryInst is a multi-
stage end-to-end system that treats instances of interest as learnable queries, enabling …

In defense of online models for video instance segmentation

J Wu, Q Liu, Y Jiang, S Bai, A Yuille, X Bai - European Conference on …, 2022 - Springer
In recent years, video instance segmentation (VIS) has been largely advanced by offline
models, while online models gradually attracted less attention possibly due to their inferior …

Vita: Video instance segmentation via object token association

M Heo, S Hwang, SW Oh, JY Lee… - Advances in Neural …, 2022 - proceedings.neurips.cc
We introduce a novel paradigm for offline Video Instance Segmentation (VIS), based on the
hypothesis that explicit object-oriented information can be a strong clue for understanding …

Video k-net: A simple, strong, and unified baseline for video segmentation

X Li, W Zhang, J Pang, K Chen… - Proceedings of the …, 2022 - openaccess.thecvf.com
This paper presents Video K-Net, a simple, strong, and unified framework for fully end-to-
end video panoptic segmentation. The method is built upon K-Net, a method that unifies …

A survey on deep learning technique for video segmentation

T Zhou, F Porikli, DJ Crandall… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Video segmentation—partitioning video frames into multiple segments or objects—plays a
critical role in a broad range of practical applications, from enhancing visual effects in movie …

Seqformer: Sequential transformer for video instance segmentation

J Wu, Y Jiang, S Bai, W Zhang, X Bai - European Conference on Computer …, 2022 - Springer
In this work, we present SeqFormer for video instance segmentation. SeqFormer follows the
principle of vision transformer that models instance relationships among video frames …

Video instance segmentation using inter-frame communication transformers

S Hwang, M Heo, SW Oh… - Advances in Neural …, 2021 - proceedings.neurips.cc
We propose a novel end-to-end solution for video instance segmentation (VIS) based on
transformers. Recently, the per-clip pipeline shows superior performance over per-frame …

Temporally efficient vision transformer for video instance segmentation

S Yang, X Wang, Y Li, Y Fang, J Fang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Recently vision transformer has achieved tremendous success on image-level visual
recognition tasks. To effectively and efficiently model the crucial temporal information within …