Propainter: Improving propagation and transformer for video inpainting

S Zhou, C Li, KCK Chan… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Flow-based propagation and spatiotemporal Transformer are two mainstream mechanisms
in video inpainting (VI). Despite the effectiveness of these components, they still suffer from …

Towards an end-to-end framework for flow-guided video inpainting

Z Li, CZ Lu, J Qin, CL Guo… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Optical flow, which captures motion information across frames, is exploited in recent video
inpainting methods through propagating pixels along its trajectories. However, the hand …

Backdoor defense via decoupling the training process

K Huang, Y Li, B Wu, Z Qin, K Ren - arxiv preprint arxiv:2202.03423, 2022 - arxiv.org
Recent studies have revealed that deep neural networks (DNNs) are vulnerable to backdoor
attacks, where attackers embed hidden backdoors in the DNN model by poisoning a few …

Fuseformer: Fusing fine-grained information in transformers for video inpainting

R Liu, H Deng, Y Huang, X Shi, L Lu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Transformer, as a strong and flexible architecture for modelling long-range relations, has
been widely explored in vision tasks. However, when used in video inpainting that requires …

Flow-guided transformer for video inpainting

K Zhang, J Fu, D Liu - European Conference on Computer Vision, 2022 - Springer
We propose a flow-guided transformer, which innovatively leverage the motion discrepancy
exposed by optical flows to instruct the attention retrieval in transformer for high fidelity video …

Towards language-driven video inpainting via multimodal large language models

J Wu, X Li, C Si, S Zhou, J Yang… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce a new task--language-driven video inpainting which uses natural language
instructions to guide the inpainting process. This approach overcomes the limitations of …

Inertia-guided flow completion and style fusion for video inpainting

K Zhang, J Fu, D Liu - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
Physical objects have inertia, which resists changes in the velocity and motion direction.
Inspired by this, we introduce inertia prior that optical flow, which reflects object motion in a …

Progressive temporal feature alignment network for video inpainting

X Zou, L Yang, D Liu, YJ Lee - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Video inpainting aims to fill spatio-temporal" corrupted" regions with plausible content. To
achieve this goal, it is necessary to find correspondences from neighbouring frames to …

Decoupled spatial-temporal transformer for video inpainting

R Liu, H Deng, Y Huang, X Shi, L Lu, W Sun… - arxiv preprint arxiv …, 2021 - arxiv.org
Video inpainting aims to fill the given spatiotemporal holes with realistic appearance but is
still a challenging task even with prosperous deep learning approaches. Recent works …

Internal video inpainting by implicit long-range propagation

H Ouyang, T Wang, Q Chen - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
We propose a novel framework for video inpainting by adopting an internal learning
strategy. Unlike previous methods that use optical flow for cross-frame context propagation …