Prediction during language comprehension: what is next?

R Ryskin, MS Nieuwland - Trends in Cognitive Sciences, 2023 - cell.com
Prediction is often regarded as an integral aspect of incremental language comprehension,
but little is known about the cognitive architectures and mechanisms that support it. We …

Predicting while comprehending language: A theory and review.

MJ Pickering, C Gambi - Psychological bulletin, 2018 - psycnet.apa.org
Researchers agree that comprehenders regularly predict upcoming language, but they do
not always agree on what prediction is (and how to differentiate it from integration) or what …

Large-scale evidence for logarithmic effects of word predictability on reading time

C Shain, C Meister, T Pimentel, R Cotterell… - Proceedings of the …, 2024 - pnas.org
During real-time language comprehension, our minds rapidly decode complex meanings
from sequences of words. The difficulty of doing so is known to be related to words' …

What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language models

A Ettinger - Transactions of the Association for Computational …, 2020 - direct.mit.edu
Pre-training by language modeling has become a popular and successful approach to NLP
tasks, but we have yet to understand exactly what linguistic capacities these pre-training …

A hierarchy of linguistic predictions during natural language comprehension

M Heilbron, K Armeni, JM Schoffelen, P Hagoort… - Proceedings of the …, 2022 - pnas.org
Understanding spoken language requires transforming ambiguous acoustic streams into a
hierarchy of representations, from phonemes to meaning. It has been suggested that the …

What do we mean by prediction in language comprehension?

GR Kuperberg, TF Jaeger - Language, cognition and neuroscience, 2016 - Taylor & Francis
We consider several key aspects of prediction in language comprehension: its
computational nature, the representational level (s) at which we predict, whether we use …

Large-scale replication study reveals a limit on probabilistic prediction in language comprehension

MS Nieuwland, S Politzer-Ahles, E Heyselaar… - ELife, 2018 - elifesciences.org
Do people routinely pre-activate the meaning and even the phonological form of upcoming
words? The most acclaimed evidence for phonological prediction comes from a 2005 Nature …

Modelling the N400 brain potential as change in a probabilistic representation of meaning

M Rabovsky, SS Hansen, JL McClelland - Nature human behaviour, 2018 - nature.com
The N400 component of the event-related brain potential has aroused much interest
because it is thought to provide an online measure of meaning processing in the brain …

fMRI reveals language-specific predictive coding during naturalistic sentence comprehension

C Shain, IA Blank, M van Schijndel, W Schuler… - Neuropsychologia, 2020 - Elsevier
Much research in cognitive neuroscience supports prediction as a canonical computation of
cognition across domains. Is such predictive coding implemented by feedback from higher …

A tale of two positivities and the N400: Distinct neural signatures are evoked by confirmed and violated predictions at different levels of representation

GR Kuperberg, T Brothers, EW Wlotko - Journal of cognitive …, 2020 - direct.mit.edu
It has been proposed that hierarchical prediction is a fundamental computational principle
underlying neurocognitive processing. Here, we ask whether the brain engages distinct …