Modulated contrast for versatile image synthesis

F Zhan, J Zhang, Y Yu, R Wu… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Perceiving the similarity between images has been a long-standing and fundamental
problem underlying various visual generation tasks. Predominant approaches measure the …

[PDF][PDF] Multimodal image synthesis and editing: A survey

F Zhan, Y Yu, R Wu, J Zhang, S Lu, L Liu… - arxiv preprint arxiv …, 2022 - pure.mpg.de
As information exists in various modalities in real world, effective interaction and fusion
among multimodal information plays a key role for the creation and perception of multimodal …

Auto-regressive image synthesis with integrated quantization

F Zhan, Y Yu, R Wu, J Zhang, K Cui, C Zhang… - European Conference on …, 2022 - Springer
Deep generative models have achieved conspicuous progress in realistic image synthesis
with multifarious conditional inputs, while generating diverse yet high-fidelity images …

Unbalanced feature transport for exemplar-based image translation

F Zhan, Y Yu, K Cui, G Zhang, S Lu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Despite the great success of GANs in images translation with different conditioned inputs
such as semantic segmentation and edge map, generating high-fidelity images with …

Diverse image inpainting with bidirectional and autoregressive transformers

Y Yu, F Zhan, R Wu, J Pan, K Cui, S Lu, F Ma… - Proceedings of the 29th …, 2021 - dl.acm.org
Image inpainting is an underdetermined inverse problem, which naturally allows diverse
contents to fill up the missing or corrupted regions realistically. Prevalent approaches using …

Vmrf: View matching neural radiance fields

J Zhang, F Zhan, R Wu, Y Yu, W Zhang… - Proceedings of the 30th …, 2022 - dl.acm.org
Neural Radiance Fields (NeRF) has demonstrated very impressive performance in novel
view synthesis via implicitly modelling 3D representations from multi-view 2D images …

Emlight: Lighting estimation via spherical distribution approximation

F Zhan, C Zhang, Y Yu, Y Chang, S Lu, F Ma… - Proceedings of the AAAI …, 2021 - ojs.aaai.org
Illumination estimation from a single image is critical in 3D rendering and it has been
investigated extensively in the computer vision and computer graphic research community …

Marginal contrastive correspondence for guided image generation

F Zhan, Y Yu, R Wu, J Zhang, S Lu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Exemplar-based image translation establishes dense correspondences between a
conditional input and an exemplar (from two different domains) for leveraging detailed …

Sparse needlets for lighting estimation with spherical transport loss

F Zhan, C Zhang, W Hu, S Lu, F Ma… - Proceedings of the …, 2021 - openaccess.thecvf.com
Accurate lighting estimation is challenging yet critical to many computer vision and computer
graphics tasks such as high-dynamic-range (HDR) relighting. Existing approaches model …

Diffusionlight: Light probes for free by painting a chrome ball

P Phongthawee, W Chinchuthakun… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present a simple yet effective technique to estimate lighting in a single input image.
Current techniques rely heavily on HDR panorama datasets to train neural networks to …