Sit: Exploring flow and diffusion-based generative models with scalable interpolant transformers
Abstract We present Scalable Interpolant Transformers (SiT), a family of generative models
built on the backbone of Diffusion Transformers (DiT). The interpolant framework, which …
built on the backbone of Diffusion Transformers (DiT). The interpolant framework, which …
The probability flow ode is provably fast
We provide the first polynomial-time convergence guarantees for the probabilistic flow ODE
implementation (together with a corrector step) of score-based generative modeling. Our …
implementation (together with a corrector step) of score-based generative modeling. Our …
Linear convergence bounds for diffusion models via stochastic localization
Diffusion models are a powerful method for generating approximate samples from high-
dimensional data distributions. Several recent results have provided polynomial bounds on …
dimensional data distributions. Several recent results have provided polynomial bounds on …
Learning mixtures of gaussians using the DDPM objective
Recent works have shown that diffusion models can learn essentially any distribution
provided one can perform score estimation. Yet it remains poorly understood under what …
provided one can perform score estimation. Yet it remains poorly understood under what …
Towards faster non-asymptotic convergence for diffusion-based generative models
Diffusion models, which convert noise into new data instances by learning to reverse a
Markov diffusion process, have become a cornerstone in contemporary generative …
Markov diffusion process, have become a cornerstone in contemporary generative …
A sharp convergence theory for the probability flow odes of diffusion models
Diffusion models, which convert noise into new data instances by learning to reverse a
diffusion process, have become a cornerstone in contemporary generative modeling. In this …
diffusion process, have become a cornerstone in contemporary generative modeling. In this …
Unraveling the smoothness properties of diffusion models: A gaussian mixture perspective
Diffusion models have made rapid progress in generating high-quality samples across
various domains. However, a theoretical understanding of the Lipschitz continuity and …
various domains. However, a theoretical understanding of the Lipschitz continuity and …
Accelerating convergence of score-based diffusion models, provably
Score-based diffusion models, while achieving remarkable empirical performance, often
suffer from low sampling speed, due to extensive function evaluations needed during the …
suffer from low sampling speed, due to extensive function evaluations needed during the …
Stochastic runge-kutta methods: Provable acceleration of diffusion models
Diffusion models play a pivotal role in contemporary generative modeling, claiming state-of-
the-art performance across various domains. Despite their superior sample quality …
the-art performance across various domains. Despite their superior sample quality …
Contractive diffusion probabilistic models
Diffusion probabilistic models (DPMs) have emerged as a promising technology in
generative modeling. The success of DPMs relies on two ingredients: time reversal of …
generative modeling. The success of DPMs relies on two ingredients: time reversal of …