Long-context modeling capabilities of Large Language Models (LLMs) have garnered
widespread attention, leading to the emergence of LLMs with ultra-context windows …

In recent years, the input context sizes of large language models (LLMs) have increased
dramatically. However, existing evaluation methods have not kept pace, failing to …

Long-context modeling capabilities are important for large language models (LLMs) in
various applications. However, directly training LLMs with long context windows is …

Having access to public opinion for a particular product can be a cumbersome task. There
are multiple reviews for the same product. Some may be good or bad depending on the bias …

This paper presents the Long Context and Form Output (LCFO) benchmark, a novel
evaluation framework for assessing gradual summarization and summary expansion …

Understanding information from a collection of multiple documents, particularly those with
visually rich elements, is important for document-grounded question answering. This paper …

We argue that there are two major distinct capabilities in long context understanding:
retrieval and holistic understanding. Understanding and further improving LLMs' long …