Mastering Board Games by External and Internal Planning with Language Models

J Schultz, J Adamek, M Jusup, M Lanctot… - arxiv preprint arxiv …, 2024 - arxiv.org
While large language models perform well on a range of complex tasks (eg, text generation,
question answering, summarization), robust multi-step planning and reasoning remains a …

Spectral Journey: How Transformers Predict the Shortest Path

A Cohen, A Gromov, K Yang, Y Tian - arxiv preprint arxiv:2502.08794, 2025 - arxiv.org
Decoder-only transformers lead to a step-change in capability of large language models.
However, opinions are mixed as to whether they are really planning or reasoning. A path to …

Prompting Strategies for Enabling Large Language Models to Infer Causation from Correlation

E Sgouritsa, V Aglietti, YW Teh, A Doucet… - arxiv preprint arxiv …, 2024 - arxiv.org
The reasoning abilities of Large Language Models (LLMs) are attracting increasing
attention. In this work, we focus on causal reasoning and address the task of establishing …