Diffusion models: A comprehensive survey of methods and applications

L Yang, Z Zhang, Y Song, S Hong, R Xu, Y Zhao… - ACM Computing …, 2023 - dl.acm.org
Diffusion models have emerged as a powerful new family of deep generative models with
record-breaking performance in many applications, including image synthesis, video …

Diffusion models in bioinformatics and computational biology

Z Guo, J Liu, Y Wang, M Chen, D Wang, D Xu… - Nature reviews …, 2024 - nature.com
Denoising diffusion models embody a type of generative artificial intelligence that can be
applied in computer vision, natural language processing and bioinformatics. In this Review …

Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation

H Wang, X Du, J Li, RA Yeh… - Proceedings of the …, 2023 - openaccess.thecvf.com
A diffusion model learns to predict a vector field of gradients. We propose to apply chain rule
on the learned gradients, and back-propagate the score of a diffusion model through the …

Palette: Image-to-image diffusion models

C Saharia, W Chan, H Chang, C Lee, J Ho… - ACM SIGGRAPH 2022 …, 2022 - dl.acm.org
This paper develops a unified framework for image-to-image translation based on
conditional diffusion models and evaluates this framework on four challenging image-to …

Lion: Latent point diffusion models for 3d shape generation

A Vahdat, F Williams, Z Gojcic… - Advances in …, 2022 - proceedings.neurips.cc
Denoising diffusion models (DDMs) have shown promising results in 3D point cloud
synthesis. To advance 3D DDMs and make them useful for digital artists, we require (i) high …

Image super-resolution via iterative refinement

C Saharia, J Ho, W Chan, T Salimans… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
We present SR3, an approach to image Super-Resolution via Repeated Refinement. SR3
adapts denoising diffusion probabilistic models (Ho et al. 2020),(Sohl-Dickstein et al. 2015) …

Score-based generative modeling through stochastic differential equations

Y Song, J Sohl-Dickstein, DP Kingma, A Kumar… - arxiv preprint arxiv …, 2020 - arxiv.org
Creating noise from data is easy; creating data from noise is generative modeling. We
present a stochastic differential equation (SDE) that smoothly transforms a complex data …

Rodin: A generative model for sculpting 3d digital avatars using diffusion

T Wang, B Zhang, T Zhang, S Gu… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper presents a 3D diffusion model that automatically generates 3D digital avatars
represented as neural radiance fields (NeRFs). A significant challenge for 3D diffusion is …

Resshift: Efficient diffusion model for image super-resolution by residual shifting

Z Yue, J Wang, CC Loy - Advances in Neural Information …, 2023 - proceedings.neurips.cc
Diffusion-based image super-resolution (SR) methods are mainly limited by the low
inference speed due to the requirements of hundreds or even thousands of sampling steps …

Zero-shot text-guided object generation with dream fields

A Jain, B Mildenhall, JT Barron… - Proceedings of the …, 2022 - openaccess.thecvf.com
We combine neural rendering with multi-modal image and text representations to synthesize
diverse 3D objects solely from natural language descriptions. Our method, Dream Fields …