Cotracker: It is better to track together

N Karaev, I Rocco, B Graham, N Neverova… - … on Computer Vision, 2024 - Springer
We introduce CoTracker, a transformer-based model that tracks a large number of 2D points
in long video sequences. Differently from most existing approaches that track points …

Gmflow: Learning optical flow via global matching

H Xu, J Zhang, J Cai… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning-based optical flow estimation has been dominated with the pipeline of cost volume
with convolutions for flow regression, which is inherently limited to local correlations and …

Unifying flow, stereo and depth estimation

H Xu, J Zhang, J Cai, H Rezatofighi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
We present a unified formulation and model for three motion and 3D perception tasks:
optical flow, rectified stereo matching and unrectified stereo depth estimation from posed …

Transflow: Transformer as flow learner

Y Lu, Q Wang, S Ma, T Geng… - Proceedings of the …, 2023 - openaccess.thecvf.com
Optical flow is an indispensable building block for various important computer vision tasks,
including motion estimation, object tracking, and disparity measurement. In this work, we …

Hierarchical neural architecture search for deep stereo matching

X Cheng, Y Zhong, M Harandi, Y Dai… - Advances in neural …, 2020 - proceedings.neurips.cc
To reduce the human efforts in neural network design, Neural Architecture Search (NAS)
has been applied with remarkable success to various high-level vision tasks such as …

Craft: Cross-attentional flow transformer for robust optical flow

X Sui, S Li, X Geng, Y Wu, X Xu, Y Liu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Optical flow estimation aims to find the 2D motion field by identifying corresponding pixels
between two images. Despite the tremendous progress of deep learning-based optical flow …

Global matching with overlap** attention for optical flow estimation

S Zhao, L Zhao, Z Zhang, E Zhou… - Proceedings of the …, 2022 - openaccess.thecvf.com
Optical flow estimation is a fundamental task in computer vision. Recent direct-regression
methods using deep neural networks achieve remarkable performance improvement …

Separable flow: Learning motion cost volumes for optical flow estimation

F Zhang, OJ Woodford… - Proceedings of the …, 2021 - openaccess.thecvf.com
Full-motion cost volumes play a central role in current state-of-the-art optical flow methods.
However, constructed using simple feature correlations, they lack the ability to encapsulate …

RGB-D saliency detection via cascaded mutual information minimization

J Zhang, DP Fan, Y Dai, X Yu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Existing RGB-D saliency detection models do not explicitly encourage RGB and depth to
achieve effective multi-modal learning. In this paper, we introduce a novel multi-stage …

Taptr: Tracking any point with transformers as detection

H Li, H Zhang, S Liu, Z Zeng, T Ren, F Li… - European Conference on …, 2024 - Springer
In this paper, we propose a simple yet effective approach for Tracking Any Point with
TRansformers (TAPTR). Based on the observation that point tracking bears a great …