An overview of diffusion models: Applications, guided generation, statistical rates and optimization

M Chen, S Mei, J Fan, M Wang - arxiv preprint arxiv:2404.07771, 2024 - arxiv.org
Diffusion models, a powerful and universal generative AI technology, have achieved
tremendous success in computer vision, audio, reinforcement learning, and computational …

Opportunities and challenges of diffusion models for generative AI

M Chen, S Mei, J Fan, M Wang - National Science Review, 2024 - academic.oup.com
Diffusion models, a powerful and universal generative artificial intelligence technology, have
achieved tremendous success and opened up new possibilities in diverse applications. In …

Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptions

S Chen, S Chewi, J Li, Y Li, A Salim… - arxiv preprint arxiv …, 2022 - arxiv.org
We provide theoretical convergence guarantees for score-based generative models (SGMs)
such as denoising diffusion probabilistic models (DDPMs), which constitute the backbone of …

Score approximation, estimation and distribution recovery of diffusion models on low-dimensional data

M Chen, K Huang, T Zhao… - … Conference on Machine …, 2023 - proceedings.mlr.press
Diffusion models achieve state-of-the-art performance in various generation tasks. However,
their theoretical foundations fall far behind. This paper studies score approximation …

Improved analysis of score-based generative modeling: User-friendly bounds under minimal smoothness assumptions

H Chen, H Lee, J Lu - International Conference on Machine …, 2023 - proceedings.mlr.press
We give an improved theoretical analysis of score-based generative modeling. Under a
score estimate with small $ L^ 2$ error (averaged across timesteps), we provide efficient …

The probability flow ode is provably fast

S Chen, S Chewi, H Lee, Y Li, J Lu… - Advances in Neural …, 2023 - proceedings.neurips.cc
We provide the first polynomial-time convergence guarantees for the probabilistic flow ODE
implementation (together with a corrector step) of score-based generative modeling. Our …

Diffusion models are minimax optimal distribution estimators

K Oko, S Akiyama, T Suzuki - International Conference on …, 2023 - proceedings.mlr.press
While efficient distribution learning is no doubt behind the groundbreaking success of
diffusion modeling, its theoretical guarantees are quite limited. In this paper, we provide the …

Diffusion schrödinger bridge with applications to score-based generative modeling

V De Bortoli, J Thornton, J Heng… - Advances in Neural …, 2021 - proceedings.neurips.cc
Progressively applying Gaussian noise transforms complex data distributions to
approximately Gaussian. Reversing this dynamic defines a generative model. When the …

Convergence of denoising diffusion models under the manifold hypothesis

V De Bortoli - arxiv preprint arxiv:2208.05314, 2022 - arxiv.org
Denoising diffusion models are a recent class of generative models exhibiting state-of-the-
art performance in image and audio synthesis. Such models approximate the time-reversal …

Convergence for score-based generative modeling with polynomial complexity

H Lee, J Lu, Y Tan - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Score-based generative modeling (SGM) is a highly successful approach for learning a
probability distribution from data and generating further samples. We prove the first …