Jailbreaks on large language models (LLMs) have recently received increasing attention.
For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with …

Text-to-image diffusion models, eg Stable Diffusion (SD), lately have shown remarkable
ability in high-quality content generation, and become one of the representatives for the …

Generative models are rapidly gaining popularity and being integrated into everyday
applications, raising concerns over their safe use as various vulnerabilities are exposed. In …

Warning: this paper contains content that may be inappropriate or offensive. As generative
models become available for public use in various applications, testing and analyzing …

AI Safety is an emerging area of critical importance to the safe adoption and deployment of
AI systems. With the rapid proliferation of AI and especially with the recent advancement of …

As large language models (LLMs) become increasingly integrated into daily applications, it
is essential to ensure they operate fairly across diverse user demographics. In this work, we …

Automated red teaming can discover rare model failures and generate challenging
examples that can be used for training or evaluation. However, a core challenge in …

The safety defense methods of Large language models (LLMs) stays limited because the
dangerous prompts are manually curated to just few known attack types, which fails to keep …

The advancement of large language models has significantly improved natural language
processing. However, challenges such as jailbreaks (prompt injections that cause an LLM to …

Recent work has proposed automated red-teaming methods for testing the vulnerabilities of
a given target large language model (LLM). These methods use red-teaming LLMs to …