Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation

M Zhou, H Zheng, Z Wang, M Yin… - Forty-first International …, 2024 - openreview.net
We introduce Score identity Distillation (SiD), an innovative data-free method that distills the
generative capabilities of pretrained diffusion models into a single-step generator. SiD not …

Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step

M Zhou, H Zheng, Y Gu, Z Wang, H Huang - arxiv preprint arxiv …, 2024 - arxiv.org
Score identity Distillation (SiD) is a data-free method that has achieved SOTA performance
in image generation by leveraging only a pretrained diffusion model, without requiring any …

Long and Short Guidance in Score identity Distillation for One-Step Text-to-Image Generation

M Zhou, Z Wang, H Zheng, H Huang - arxiv preprint arxiv:2406.01561, 2024 - arxiv.org
Diffusion-based text-to-image generation models trained on extensive text-image pairs have
shown the capacity to generate photorealistic images consistent with textual descriptions …

Provable Sample-Efficient Transfer Learning Conditional Diffusion Models via Representation Learning

Z Cheng, T **e, S Zhang, C Zhang - arxiv preprint arxiv:2502.04491, 2025 - arxiv.org
While conditional diffusion models have achieved remarkable success in various
applications, they require abundant data to train from scratch, which is often infeasible in …

Learning variational autoencoders via MCMC speed measures

M Hirt, V Kreouzis, P Dellaportas - Statistics and Computing, 2024 - Springer
Variational autoencoders (VAEs) are popular likelihood-based generative models which can
be efficiently trained by maximising an evidence lower bound. There has been much …

Kernel Semi-Implicit Variational Inference

Z Cheng, L Yu, T **e, S Zhang, C Zhang - arxiv preprint arxiv:2405.18997, 2024 - arxiv.org
Semi-implicit variational inference (SIVI) extends traditional variational families with semi-
implicit distributions defined in a hierarchical manner. Due to the intractable densities of …