A generalist framework for panoptic segmentation of images and videos

T Chen, L Li, S Saxena, G Hinton… - Proceedings of the …, 2023 - openaccess.thecvf.com
Panoptic segmentation assigns semantic and instance ID labels to every pixel of an image.
As permutations of instance IDs are also valid solutions, the task requires learning of high …

[HTML][HTML] Coarse-to-fine video instance segmentation with factorized conditional appearance flows

Z Qin, X Lu, X Nie, D Liu, Y Yin, W Wang - IEEE/CAA Journal of …, 2023 - ieee-jas.net
We introduce a novel method using a new generative model that automatically learns
effective representations of the target and background appearance to detect, segment and …

Track to detect and segment: An online multi-object tracker

J Wu, J Cao, L Song, Y Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Most online multi-object trackers perform object detection stand-alone in a neural net without
any input from tracking. In this paper, we present a new online joint detection and tracking …

Instances as queries

Y Fang, S Yang, X Wang, Y Li, C Fang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present QueryInst, a new perspective for instance segmentation. QueryInst is a multi-
stage end-to-end system that treats instances of interest as learnable queries, enabling …

In defense of online models for video instance segmentation

J Wu, Q Liu, Y Jiang, S Bai, A Yuille, X Bai - European Conference on …, 2022 - Springer
In recent years, video instance segmentation (VIS) has been largely advanced by offline
models, while online models gradually attracted less attention possibly due to their inferior …

Ow-detr: Open-world detection transformer

A Gupta, S Narayan, KJ Joseph… - Proceedings of the …, 2022 - openaccess.thecvf.com
Open-world object detection (OWOD) is a challenging computer vision problem, where the
task is to detect a known set of object categories while simultaneously identifying unknown …

Learning equivariant segmentation with instance-unique querying

W Wang, J Liang, D Liu - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Prevalent state-of-the-art instance segmentation methods fall into a query-based scheme, in
which instance masks are derived by querying the image feature using a set of instance …

You only segment once: Towards real-time panoptic segmentation

J Hu, L Huang, T Ren, S Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we propose YOSO, a real-time panoptic segmentation framework. YOSO
predicts masks via dynamic convolutions between panoptic kernels and image feature …

Tf-blender: Temporal feature blender for video object detection

Y Cui, L Yan, Z Cao, D Liu - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Video objection detection is a challenging task because isolated video frames may
encounter appearance deterioration, which introduces great confusion for detection. One of …

Sg-net: Spatial granularity network for one-stage video instance segmentation

D Liu, Y Cui, W Tan, Y Chen - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Video instance segmentation (VIS) is a new and critical task in computer vision. To date, top-
performing VIS methods extend the two-stage Mask R-CNN by adding a tracking branch …