Dynamical regimes of diffusion models

G Biroli, T Bonnaire, V De Bortoli, M Mézard - Nature Communications, 2024 - nature.com
We study generative diffusion models in the regime where both the data dimension and the
sample size are large, and the score function is trained optimally. Using statistical physics …

The emergence of reproducibility and consistency in diffusion models

H Zhang, J Zhou, Y Lu, M Guo, P Wang… - Forty-first International …, 2024 - openreview.net
In this work, we investigate an intriguing and prevalent phenomenon of diffusion models
which we term as" consistent model reproducibility'': given the same starting noise input and …

On memorization in diffusion models

X Gu, C Du, T Pang, C Li, M Lin, Y Wang - arxiv preprint arxiv:2310.02664, 2023 - arxiv.org
Due to their capacity to generate novel and high-quality samples, diffusion models have
attracted significant research interest in recent years. Notably, the typical training objective of …

Sequence-augmented se (3)-flow matching for conditional protein backbone generation

G Huguet, J Vuckovic, K Fatras… - arxiv preprint arxiv …, 2024 - arxiv.org
Proteins are essential for almost all biological processes and derive their diverse functions
from complex 3D structures, which are in turn determined by their amino acid sequences. In …

Diffusion models learn low-dimensional distributions via subspace clustering

P Wang, H Zhang, Z Zhang, S Chen, Y Ma… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent empirical studies have demonstrated that diffusion models can effectively learn the
image distribution and generate new samples. Remarkably, these models can achieve this …

A sharp convergence theory for the probability flow odes of diffusion models

G Li, Y Wei, Y Chi, Y Chen - arxiv preprint arxiv:2408.02320, 2024 - arxiv.org
Diffusion models, which convert noise into new data instances by learning to reverse a
diffusion process, have become a cornerstone in contemporary generative modeling. In this …

From denoising diffusions to denoising markov models

J Benton, Y Shi, V De Bortoli… - Journal of the Royal …, 2024 - academic.oup.com
Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical
performance. They work by diffusing the data distribution into a Gaussian distribution and …

Understanding generalizability of diffusion models requires rethinking the hidden gaussian structure

X Li, Y Dai, Q Qu - Advances in Neural Information …, 2025 - proceedings.neurips.cc
In this work, we study the generalizability of diffusion models by looking into the hidden
properties of the learned score functions, which are essentially a series of deep denoisers …

Deep generative models through the lens of the manifold hypothesis: A survey and new connections

G Loaiza-Ganem, BL Ross, R Hosseinzadeh… - arxiv preprint arxiv …, 2024 - arxiv.org
In recent years there has been increased interest in understanding the interplay between
deep generative models (DGMs) and the manifold hypothesis. Research in this area focuses …

Automatic change-point detection in time series via deep learning

J Li, P Fearnhead, P Fryzlewicz… - Journal of the Royal …, 2024 - academic.oup.com
Detecting change points in data is challenging because of the range of possible types of
change and types of behaviour of data when there is no change. Statistically efficient …