Fast high-resolution image synthesis with latent adversarial diffusion distillation

A Sauer, F Boesel, T Dockhorn, A Blattmann… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
Diffusion models are the main driver of progress in image and video synthesis, but suffer
from slow inference speed. Distillation methods, like the recently introduced adversarial …

One step diffusion via shortcut models

K Frans, D Hafner, S Levine, P Abbeel - arxiv preprint arxiv:2410.12557, 2024 - arxiv.org
Diffusion models and flow-matching models have enabled generating diverse and realistic
images by learning to transfer noise to data. However, sampling from these models involves …

Bidirectional consistency models

L Li, J He - arxiv preprint arxiv:2403.18035, 2024 - arxiv.org
Diffusion models (DMs) are capable of generating remarkably high-quality samples by
iteratively denoising a random vector, a process that corresponds to moving along the …

Diffusion model predictive control

G Zhou, S Swaminathan, RV Raju… - arxiv preprint arxiv …, 2024 - arxiv.org
We propose Diffusion Model Predictive Control (D-MPC), a novel MPC approach that learns
a multi-step action proposal and a multi-step dynamics model, both using diffusion models …

Training neural samplers with reverse diffusive kl divergence

J He, W Chen, M Zhang, D Barber… - arxiv preprint arxiv …, 2024 - arxiv.org
Training generative models to sample from unnormalized density functions is an important
and challenging task in machine learning. Traditional training methods often rely on the …

Variational distillation of diffusion policies into mixture of experts

H Zhou, D Blessing, G Li, O Celik… - Advances in …, 2025 - proceedings.neurips.cc
Abstract This work introduces Variational Diffusion Distillation (VDD), a novel method that
distills denoising diffusion policies into Mixtures of Experts (MoE) through variational …

From slow bidirectional to fast causal video generators

T Yin, Q Zhang, R Zhang, WT Freeman… - arxiv preprint arxiv …, 2024 - arxiv.org
Current video diffusion models achieve impressive generation quality but struggle in
interactive applications due to bidirectional attention dependencies. The generation of a …

Multi-student Diffusion Distillation for Better One-step Generators

Y Song, J Lorraine, W Nie, K Kreis, J Lucas - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion models achieve high-quality sample generation at the cost of a lengthy multistep
inference procedure. To overcome this, diffusion distillation techniques produce student …

Dollar: Few-step video generation via distillation and latent reward optimization

Z Ding, C **, D Liu, H Zheng, KK Singh… - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion probabilistic models have shown significant progress in video generation;
however, their computational efficiency is limited by the large number of sampling steps …

DDIL: Improved Diffusion Distillation With Imitation Learning

R Garrepalli, S Mahajan, M Hayat, F Porikli - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion models excel at generative modeling (eg, text-to-image) but sampling requires
multiple denoising network passes, limiting practicality. Efforts such as progressive …