The mystery of in-context learning: A comprehensive survey on interpretation and analysis

Y Zhou, J Li, Y **ang, H Yan, L Gui… - Proceedings of the 2024 …, 2024 - aclanthology.org
Understanding in-context learning (ICL) capability that enables large language models
(LLMs) to excel in proficiency through demonstration examples is of utmost importance. This …

Competition Dynamics Shape Algorithmic Phases of In-Context Learning

CF Park, ES Lubana, I Pres, H Tanaka - arxiv preprint arxiv:2412.01003, 2024 - arxiv.org
In-Context Learning (ICL) has significantly expanded the general-purpose nature of large
language models, allowing them to adapt to novel tasks using merely the inputted context …

In-context learning agents are asymmetric belief updaters

JA Schubert, AK Jagadish, M Binz, E Schulz - arxiv preprint arxiv …, 2024 - arxiv.org
We study the in-context learning dynamics of large language models (LLMs) using three
instrumental learning tasks adapted from cognitive psychology. We find that LLMs update …