State of the art on neural rendering

A Tewari, O Fried, J Thies, V Sitzmann… - Computer Graphics …, 2020 - Wiley Online Library
Efficient rendering of photo‐realistic virtual worlds is a long standing effort of computer
graphics. Modern graphics techniques have succeeded in synthesizing photo‐realistic …

Cross-domain correspondence learning for exemplar-based image translation

P Zhang, B Zhang, D Chen… - Proceedings of the …, 2020 - openaccess.thecvf.com
We present a general framework for exemplar-based image translation, which synthesizes a
photo-realistic image from the input in a distinct domain (eg, semantic segmentation mask …

Cocosnet v2: Full-resolution correspondence learning for image translation

X Zhou, B Zhang, T Zhang, P Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present the full-resolution correspondence learning for cross-domain images, which aids
image translation. We adopt a hierarchical strategy that uses the correspondence from …

Imagebrush: Learning visual in-context instructions for exemplar-based image manipulation

Y Yang, H Peng, Y Shen, Y Yang… - Advances in …, 2023 - proceedings.neurips.cc
While language-guided image manipulation has made remarkable progress, the challenge
of how to instruct the manipulation process faithfully reflecting human intentions persists. An …

Deep image synthesis from intuitive user input: A review and perspectives

Y Xue, YC Guo, H Zhang, T Xu, SH Zhang… - Computational Visual …, 2022 - Springer
In many applications of computer graphics, art, and design, it is desirable for a user to
provide intuitive non-image input, such as text, sketch, stroke, graph, or layout, and have a …

Semantically multi-modal image synthesis

Z Zhu, Z Xu, A You, X Bai - … of the IEEE/CVF conference on …, 2020 - openaccess.thecvf.com
In this paper, we focus on semantically multi-modal image synthesis (SMIS) task, namely,
generating multi-modal images at the semantic level. Previous work seeks to use multiple …

Learning layout and style reconfigurable gans for controllable image synthesis

W Sun, T Wu - IEEE transactions on pattern analysis and …, 2021 - ieeexplore.ieee.org
With the remarkable recent progress on learning deep generative models, it becomes
increasingly interesting to develop models for controllable image synthesis from …

Edge guided GANs with multi-scale contrastive learning for semantic image synthesis

H Tang, G Sun, N Sebe… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
We propose a novel edge guided generative adversarial network with contrastive learning
(ECGAN) for the challenging semantic image synthesis task. Although considerable …

Midms: Matching interleaved diffusion models for exemplar-based image translation

J Seo, G Lee, S Cho, J Lee, S Kim - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
We present a novel method for exemplar-based image translation, called matching
interleaved diffusion models (MIDMs). Most existing methods for this task were formulated as …

Patchmatch-based neighborhood consensus for semantic correspondence

JY Lee, J DeGol, V Fragoso… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We address estimating dense correspondences between two images depicting different but
semantically related scenes. End-to-end trainable deep neural networks incorporating …