The llama 3 herd of models
Modern artificial intelligence (AI) systems are powered by foundation models. This paper
presents a new set of foundation models, called Llama 3. It is a herd of language models …
presents a new set of foundation models, called Llama 3. It is a herd of language models …
Dinov2: Learning robust visual features without supervision
The recent breakthroughs in natural language processing for model pretraining on large
quantities of data have opened the way for similar foundation models in computer vision …
quantities of data have opened the way for similar foundation models in computer vision …
Diffusion art or digital forgery? investigating data replication in diffusion models
Cutting-edge diffusion models produce images with high quality and customizability,
enabling them to be used for commercial art and graphic design purposes. But do diffusion …
enabling them to be used for commercial art and graphic design purposes. But do diffusion …
Ablating concepts in text-to-image diffusion models
Large-scale text-to-image diffusion models can generate high-fidelity images with powerful
compositional ability. However, these models are typically trained on an enormous amount …
compositional ability. However, these models are typically trained on an enormous amount …
Understanding and mitigating copying in diffusion models
Images generated by diffusion models like Stable Diffusion are increasingly widespread.
Recent works and even lawsuits have shown that these models are prone to replicating their …
Recent works and even lawsuits have shown that these models are prone to replicating their …
The emergence of reproducibility and consistency in diffusion models
In this work, we investigate an intriguing and prevalent phenomenon of diffusion models
which we term as" consistent model reproducibility'': given the same starting noise input and …
which we term as" consistent model reproducibility'': given the same starting noise input and …
Unveiling and mitigating memorization in text-to-image diffusion models through cross attention
Recent advancements in text-to-image (T2I) diffusion models have demonstrated their
remarkable capability to generate high-quality images from textual prompts. However …
remarkable capability to generate high-quality images from textual prompts. However …
Evaluating data attribution for text-to-image models
While large text-to-image models are able to synthesize" novel" images, these images are
necessarily a reflection of the training data. The problem of data attribution in such models …
necessarily a reflection of the training data. The problem of data attribution in such models …
Diffusion models learn low-dimensional distributions via subspace clustering
Recent empirical studies have demonstrated that diffusion models can effectively learn the
image distribution and generate new samples. Remarkably, these models can achieve this …
image distribution and generate new samples. Remarkably, these models can achieve this …
Spurious features everywhere-large-scale detection of harmful spurious features in imagenet
Benchmark performance of deep learning classifiers alone is not a reliable predictor for the
performance of a deployed model. In particular, if the image classifier has picked up …
performance of a deployed model. In particular, if the image classifier has picked up …