The llama 3 herd of models

A Dubey, A Jauhri, A Pandey, A Kadian… - arxiv preprint arxiv …, 2024 - arxiv.org
Modern artificial intelligence (AI) systems are powered by foundation models. This paper
presents a new set of foundation models, called Llama 3. It is a herd of language models …

Dinov2: Learning robust visual features without supervision

M Oquab, T Darcet, T Moutakanni, H Vo… - arxiv preprint arxiv …, 2023 - arxiv.org
The recent breakthroughs in natural language processing for model pretraining on large
quantities of data have opened the way for similar foundation models in computer vision …

Diffusion art or digital forgery? investigating data replication in diffusion models

G Somepalli, V Singla, M Goldblum… - Proceedings of the …, 2023 - openaccess.thecvf.com
Cutting-edge diffusion models produce images with high quality and customizability,
enabling them to be used for commercial art and graphic design purposes. But do diffusion …

Ablating concepts in text-to-image diffusion models

N Kumari, B Zhang, SY Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Large-scale text-to-image diffusion models can generate high-fidelity images with powerful
compositional ability. However, these models are typically trained on an enormous amount …

Understanding and mitigating copying in diffusion models

G Somepalli, V Singla, M Goldblum… - Advances in …, 2023 - proceedings.neurips.cc
Images generated by diffusion models like Stable Diffusion are increasingly widespread.
Recent works and even lawsuits have shown that these models are prone to replicating their …

The emergence of reproducibility and consistency in diffusion models

H Zhang, J Zhou, Y Lu, M Guo, P Wang… - Forty-first International …, 2023 - openreview.net
In this work, we investigate an intriguing and prevalent phenomenon of diffusion models
which we term as" consistent model reproducibility'': given the same starting noise input and …

Unveiling and mitigating memorization in text-to-image diffusion models through cross attention

J Ren, Y Li, S Zeng, H Xu, L Lyu, Y **ng… - European Conference on …, 2024 - Springer
Recent advancements in text-to-image (T2I) diffusion models have demonstrated their
remarkable capability to generate high-quality images from textual prompts. However …

Evaluating data attribution for text-to-image models

SY Wang, AA Efros, JY Zhu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
While large text-to-image models are able to synthesize" novel" images, these images are
necessarily a reflection of the training data. The problem of data attribution in such models …

Diffusion models learn low-dimensional distributions via subspace clustering

P Wang, H Zhang, Z Zhang, S Chen, Y Ma… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent empirical studies have demonstrated that diffusion models can effectively learn the
image distribution and generate new samples. Remarkably, these models can achieve this …

Spurious features everywhere-large-scale detection of harmful spurious features in imagenet

Y Neuhaus, M Augustin, V Boreiko… - Proceedings of the …, 2023 - openaccess.thecvf.com
Benchmark performance of deep learning classifiers alone is not a reliable predictor for the
performance of a deployed model. In particular, if the image classifier has picked up …