Documents are visually rich structures that convey information through text, but also figures,
page layouts, tables, or even fonts. Since modern retrieval systems mainly rely on the textual …

Multimodal interleaved datasets featuring free-form interleaved sequences of images and
text are crucial for training frontier large multimodal models (LMMs). Despite the rapid …

In recent years, vision-language models have made significant strides, excelling in tasks like
optical character recognition and geometric problem-solving. However, several critical …

We investigate the internal representations of vision-and-language models (VLMs) and how
they encode task representations. We consider tasks specified through examples or …

Comics, as a medium, uniquely combine text and images in styles often distinct from real-
world visuals. For the past three decades, computational research on comics has evolved …

Efficient and privacy-preserving multimodal interaction is essential as AR, VR, and modern
smartphones with powerful cameras become primary interfaces for human-computer …

Multi-turn interactions between large language models (LLMs) and users naturally include
implicit feedback signals. If an LLM responds in an unexpected way to an instruction, the …