Replication in visual diffusion models: A survey and outlook

W Wang, Y Sun, Z Yang, Z Hu, Z Tan… - arxiv preprint arxiv …, 2024 - arxiv.org
Visual diffusion models have revolutionized the field of creative AI, producing high-quality
and diverse content. However, they inevitably memorize training images or videos …

Towards a Theoretical Understanding of Memorization in Diffusion Models

Y Chen, X Ma, D Zou, YG Jiang - arxiv preprint arxiv:2410.02467, 2024 - arxiv.org
As diffusion probabilistic models (DPMs) are being employed as mainstream models for
Generative Artificial Intelligence (GenAI), the study of their memorization of training data has …

Investigating Memorization in Video Diffusion Models

C Chen, E Liu, D Liu, M Shah, C Xu - arxiv preprint arxiv:2410.21669, 2024 - arxiv.org
Diffusion models, widely used for image and video generation, face a significant limitation:
the risk of memorizing and reproducing training data during inference, potentially generating …

Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey

Y Zhang, Z Chen, CH Cheng, W Ruan, X Huang… - arxiv preprint arxiv …, 2024 - arxiv.org
Text-to-Image (T2I) Diffusion Models (DMs) have garnered widespread attention for their
impressive advancements in image generation. However, their growing popularity has …

Exploring local memorization in diffusion models via bright ending attention

C Chen, D Liu, M Shah, C Xu - arxiv preprint arxiv:2410.21665, 2024 - arxiv.org
In this paper, we identify and leverage a novelbright ending'(BE) anomaly in diffusion
models prone to memorizing training images to address a new task: locating localized …

CopyrightShield: Spatial Similarity Guided Backdoor Defense against Copyright Infringement in Diffusion Models

Z Guo, S Liang, A Liu, D Tao - arxiv preprint arxiv:2412.01528, 2024 - arxiv.org
The diffusion model has gained significant attention due to its remarkable data generation
ability in fields such as image synthesis. However, its strong memorization and replication …

Memorization and Regularization in Generative Diffusion Models

R Baptista, A Dasgupta, NB Kovachki, A Oberai… - arxiv preprint arxiv …, 2025 - arxiv.org
Diffusion models have emerged as a powerful framework for generative modeling. At the
heart of the methodology is score matching: learning gradients of families of log-densities for …

Finding NeMo: Localizing Neurons Responsible For Memorization in Diffusion Models

D Hintersdorf, L Struppek, K Kersting… - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion models (DMs) produce very detailed and high-quality images. Their power results
from extensive training on large amounts of data, usually scraped from the internet without …

Understanding Memorization in Generative Models via Sharpness in Probability Landscapes

D Jeon, D Kim, A No - arxiv preprint arxiv:2412.04140, 2024 - arxiv.org
In this paper, we introduce a geometric framework to analyze memorization in diffusion
models using the eigenvalues of the Hessian of the log probability density. We propose that …

PSY: Posterior Sampling Based Privacy Enhancer in Large Language Models

Y Sun, L Duan, Y Li - arxiv preprint arxiv:2410.18824, 2024 - arxiv.org
Privacy vulnerabilities in LLMs, such as leakage from memorization, have been constantly
identified, and various mitigation proposals have been proposed. LoRA is usually used in …