Chain of agents: Large language models collaborating on long-context tasks

Y Zhang, R Sun, Y Chen, T Pfister… - Advances in Neural …, 2025 - proceedings.neurips.cc
Addressing the challenge of effectively processing long contexts has become a critical issue
for Large Language Models (LLMs). Two common strategies have emerged: 1) reducing the …

How to train long-context language models (effectively)

T Gao, A Wettig, H Yen, D Chen - ar** long-context large
language models (LLMs), the compromised quality of LLM-synthesized data for supervised …

From artificial needles to real haystacks: Improving retrieval capabilities in llms by finetuning on synthetic data

Z **ong, V Papageorgiou, K Lee… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent studies have shown that Large Language Models (LLMs) struggle to accurately
retrieve information and maintain reasoning capabilities when processing long-context …