Online toxic discourses could result in conflicts between groups or harm to online
communities. Hate speech is complex and multifaceted harmful or offensive content …

Large generative AI models (LGAIMs), such as ChatGPT, GPT-4 or Stable Diffusion, are
rapidly transforming the way we communicate, illustrate, and create. However, AI regulation …

Finetuning large language models (LLMs) on instructions leads to vast performance
improvements on natural language tasks. We apply instruction tuning using code …

Multimodal data collected from the real world are often imperfect due to missing modalities.
Therefore multimodal models that are robust against modal-incomplete data are highly …

The recent performance leap of Large Language Models (LLMs) opens up new
opportunities across numerous industrial applications and domains. However, erroneous …

State-of-the-art Text-to-Image models like Stable Diffusion and DALLE\cdot2 are
revolutionizing how people generate visual content. At the same time, society has serious …

All text-based language problems can be reduced to either generation or embedding.
Current models only perform well at one or the other. We introduce generative …

The automatic identification of harmful content online is of major concern for social media
platforms, policymakers, and society. Researchers have studied textual, visual, and audio …

Memes are a widely popular tool for web users to express their thoughts using visual
metaphors. Understanding memes requires recognizing and interpreting visual metaphors …

The dissemination of hateful memes online has adverse effects on social media platforms
and the real world. Detecting hateful memes is challenging, one of the reasons being the …