Multimodal image synthesis and editing: A survey and taxonomy

F Zhan, Y Yu, R Wu, J Zhang, S Lu, L Liu… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
As information exists in various modalities in real world, effective interaction and fusion
among multimodal information plays a key role for the creation and perception of multimodal …

Dynamic neural networks: A survey

Y Han, G Huang, S Song, L Yang… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Dynamic neural network is an emerging research topic in deep learning. Compared to static
models which have fixed computational graphs and parameters at the inference stage …

Encoding in style: a stylegan encoder for image-to-image translation

E Richardson, Y Alaluf, O Patashnik… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present a generic image-to-image translation framework, pixel2style2pixel (pSp). Our
pSp framework is based on a novel encoder network that directly generates a series of style …

Focal frequency loss for image reconstruction and synthesis

L Jiang, B Dai, W Wu, CC Loy - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Image reconstruction and synthesis have witnessed remarkable progress thanks to the
development of generative models. Nonetheless, gaps could still exist between the real and …

Freestyle layout-to-image synthesis

H Xue, Z Huang, Q Sun, L Song… - Proceedings of the …, 2023 - openaccess.thecvf.com
Typical layout-to-image synthesis (LIS) models generate images for a closed set of semantic
classes, eg, 182 common objects in COCO-Stuff. In this work, we explore the freestyle …

Semantic image synthesis via diffusion models

W Wang, J Bao, W Zhou, D Chen, D Chen… - arxiv preprint arxiv …, 2022 - arxiv.org
Denoising Diffusion Probabilistic Models (DDPMs) have achieved remarkable success in
various image generation tasks compared with Generative Adversarial Nets (GANs). Recent …

Deceive d: Adaptive pseudo augmentation for gan training with limited data

L Jiang, B Dai, W Wu, CC Loy - Advances in Neural …, 2021 - proceedings.neurips.cc
Generative adversarial networks (GANs) typically require ample data for training in order to
synthesize high-fidelity images. Recent studies have shown that training GANs with limited …

You only need adversarial supervision for semantic image synthesis

V Sushko, E Schönfeld, D Zhang, J Gall… - arxiv preprint arxiv …, 2020 - arxiv.org
Despite their recent successes, GAN models for semantic image synthesis still suffer from
poor image quality when trained with only adversarial supervision. Historically, additionally …

Generative adversarial networks for image and video synthesis: Algorithms and applications

MY Liu, X Huang, J Yu, TC Wang… - Proceedings of the …, 2021 - ieeexplore.ieee.org
The generative adversarial network (GAN) framework has emerged as a powerful tool for
various image and video synthesis tasks, allowing the synthesis of visual content in an …

Dress code: High-resolution multi-category virtual try-on

D Morelli, M Fincato, M Cornia… - Proceedings of the …, 2022 - openaccess.thecvf.com
Image-based virtual try-on strives to transfer the appearance of a clothing item onto the
image of a target person. Existing literature focuses mainly on upper-body clothes (eg t …