Vitmatte: Boosting image matting with pre-trained plain vision transformers

J Yao, X Wang, S Yang, B Wang - Information Fusion, 2024 - Elsevier
Image matting is an inverse fusion process that separates the foreground and background
information by predicting alpha matte for each pixel. Recently, plain vision Transformers …

Real-time high-resolution background matting

S Lin, A Ryabtsev, S Sengupta… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce a real-time, high-resolution background replacement technique which
operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU. Our technique is …

[PDF][PDF] Total relighting: learning to relight portraits for background replacement.

R Pandey, S Orts-Escolano, C Legendre, C Haene… - ACM Trans …, 2021 - 3dvar.com
Compositing a person into a scene to look like they are really there is a fundamental
technique in visual effects, with many other applications such as smartphone photography …

Background matting: The world is your green screen

S Sengupta, V Jayaram, B Curless… - Proceedings of the …, 2020 - openaccess.thecvf.com
We propose a method for creating a matte-the per-pixel foreground color and alpha-of a
person by taking photos or videos in an everyday setting with a handheld camera. Most …

Matteformer: Transformer-based image matting via prior-tokens

GT Park, SJ Son, JY Yoo, SH Kim… - Proceedings of the …, 2022 - openaccess.thecvf.com
In this paper, we propose a transformer-based image matting model called MatteFormer,
which takes full advantage of trimap information in the transformer block. Our method first …

Attention-guided hierarchical structure aggregation for image matting

Y Qiao, Y Liu, X Yang, D Zhou, M Xu… - Proceedings of the …, 2020 - openaccess.thecvf.com
Existing deep learning based matting algorithms primarily resort to high-level semantic
features to improve the overall structure of alpha mattes. However, we argue that advanced …

Deep image matting: A comprehensive survey

J Li, J Zhang, D Tao - arxiv preprint arxiv:2304.04672, 2023 - arxiv.org
Image matting refers to extracting precise alpha matte from natural images, and it plays a
critical role in various downstream applications, such as image editing. Despite being an ill …

Modnet: Real-time trimap-free portrait matting via objective decomposition

Z Ke, J Sun, K Li, Q Yan, RWH Lau - … of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
Existing portrait matting methods either require auxiliary inputs that are costly to obtain or
involve multiple stages that are computationally expensive, making them less suitable for …

Semantic image matting

Y Sun, CK Tang, YW Tai - … of the IEEE/CVF Conference on …, 2021 - openaccess.thecvf.com
Natural image matting separates the foreground from background in fractional occupancy
which can be caused by highly transparent objects, complex foreground (eg, net or tree) …

Mask guided matting via progressive refinement network

Q Yu, J Zhang, H Zhang, Y Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract We propose Mask Guided (MG) Matting, a robust matting framework that takes a
general coarse mask as guidance. MG Matting leverages a network (PRN) design which …