The mystery of in-context learning: A comprehensive survey on interpretation and analysis
Understanding in-context learning (ICL) capability that enables large language models
(LLMs) to excel in proficiency through demonstration examples is of utmost importance. This …
(LLMs) to excel in proficiency through demonstration examples is of utmost importance. This …
Competition Dynamics Shape Algorithmic Phases of In-Context Learning
In-Context Learning (ICL) has significantly expanded the general-purpose nature of large
language models, allowing them to adapt to novel tasks using merely the inputted context …
language models, allowing them to adapt to novel tasks using merely the inputted context …
In-context learning agents are asymmetric belief updaters
We study the in-context learning dynamics of large language models (LLMs) using three
instrumental learning tasks adapted from cognitive psychology. We find that LLMs update …
instrumental learning tasks adapted from cognitive psychology. We find that LLMs update …