Analyzing and improving the training dynamics of diffusion models

T Karras, M Aittala, J Lehtinen… - Proceedings of the …, 2024 - openaccess.thecvf.com
Diffusion models currently dominate the field of data-driven image synthesis with their
unparalleled scaling to large datasets. In this paper we identify and rectify several causes for …

Giraffe: Representing scenes as compositional generative neural feature fields

M Niemeyer, A Geiger - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Deep generative models allow for photorealistic image synthesis at high resolutions. But for
many applications, this is not enough: content creation also needs to be controllable. While …

Causal transformer for estimating counterfactual outcomes

V Melnychuk, D Frauen… - … conference on machine …, 2022 - proceedings.mlr.press
Estimating counterfactual outcomes over time from observational data is relevant for many
applications (eg, personalized medicine). Yet, state-of-the-art methods build upon simple …

Large scale GAN training for high fidelity natural image synthesis

A Brock, J Donahue, K Simonyan - arxiv preprint arxiv:1809.11096, 2018 - arxiv.org
Despite recent progress in generative image modeling, successfully generating high-
resolution, diverse samples from complex datasets such as ImageNet remains an elusive …

A simple baseline for bayesian uncertainty in deep learning

WJ Maddox, P Izmailov, T Garipov… - Advances in neural …, 2019 - proceedings.neurips.cc
Abstract We propose SWA-Gaussian (SWAG), a simple, scalable, and general purpose
approach for uncertainty representation and calibration in deep learning. Stochastic Weight …

On data augmentation for GAN training

NT Tran, VH Tran, NB Nguyen… - … on Image Processing, 2021 - ieeexplore.ieee.org
Recent successes in Generative Adversarial Networks (GAN) have affirmed the importance
of using more data in GAN training. Yet it is expensive to collect data in many domains such …

Which training methods for GANs do actually converge?

L Mescheder, A Geiger… - … conference on machine …, 2018 - proceedings.mlr.press
Recent work has shown local convergence of GAN training for absolutely continuous data
and generator distributions. In this paper, we show that the requirement of absolute …

Msg-gan: Multi-scale gradients for generative adversarial networks

A Karnewar, O Wang - … of the IEEE/CVF conference on …, 2020 - openaccess.thecvf.com
Abstract While Generative Adversarial Networks (GANs) have seen huge successes in
image synthesis tasks, they are notoriously difficult to adapt to different datasets, in part due …

You only need adversarial supervision for semantic image synthesis

V Sushko, E Schönfeld, D Zhang, J Gall… - arxiv preprint arxiv …, 2020 - arxiv.org
Despite their recent successes, GAN models for semantic image synthesis still suffer from
poor image quality when trained with only adversarial supervision. Historically, additionally …

SDF‐StyleGAN: implicit SDF‐based StyleGAN for 3D shape generation

X Zheng, Y Liu, P Wang, X Tong - Computer Graphics Forum, 2022 - Wiley Online Library
We present a StyleGAN2‐based deep learning approach for 3D shape generation, called
SDF‐StyleGAN, with the aim of reducing visual and geometric dissimilarity between …