Neurocomputational models of language processing

JT Hale, L Campanelli, J Li, S Bhattasali… - Annual Review of …, 2022 - annualreviews.org
Efforts to understand the brain bases of language face the Map** Problem: At what level
do linguistic computations and representations connect to human neurobiology? We review …

Principles of intensive human neuroimaging

ER Kupers, T Knapen, EP Merriam, KN Kay - Trends in Neurosciences, 2024 - cell.com
The rise of large, publicly shared functional magnetic resonance imaging (fMRI) data sets in
human neuroscience has focused on acquiring either a few hours of data on many …

Evidence of a predictive coding hierarchy in the human brain listening to speech

C Caucheteux, A Gramfort, JR King - Nature human behaviour, 2023 - nature.com
Considerable progress has recently been made in natural language processing: deep
learning algorithms are increasingly able to generate, summarize, translate and classify …

Brains and algorithms partially converge in natural language processing

C Caucheteux, JR King - Communications biology, 2022 - nature.com
Deep learning algorithms trained to predict masked words from large amount of text have
recently been shown to generate activations similar to those of the human brain. However …

Driving and suppressing the human language network using large language models

G Tuckute, A Sathe, S Srikant, M Taliaferro… - Nature Human …, 2024 - nature.com
Transformer models such as GPT generate human-like language and are predictive of
human brain responses to language. Here, using functional-MRI-measured brain responses …

Toward a realistic model of speech processing in the brain with self-supervised learning

J Millet, C Caucheteux, Y Boubenec… - Advances in …, 2022 - proceedings.neurips.cc
Several deep neural networks have recently been shown to generate activations similar to
those of the brain in response to the same input. These algorithms, however, remain largely …

Scaling laws for language encoding models in fMRI

R Antonello, A Vaidya, A Huth - Advances in Neural …, 2023 - proceedings.neurips.cc
Abstract Representations from transformer-based unidirectional language models are
known to be effective at predicting brain responses to natural language. However, most …

A natural language fMRI dataset for voxelwise encoding models

A LeBel, L Wagner, S Jain, A Adhikari-Desai, B Gupta… - Scientific Data, 2023 - nature.com
Speech comprehension is a complex process that draws on humans' abilities to extract
lexical information, parse syntax, and form semantic understanding. These sub-processes …

Self-supervised learning of brain dynamics from broad neuroimaging data

A Thomas, C Ré, R Poldrack - Advances in neural …, 2022 - proceedings.neurips.cc
Self-supervised learning techniques are celebrating immense success in natural language
processing (NLP) by enabling models to learn from broad language data at unprecedented …

Deep language algorithms predict semantic comprehension from brain activity

C Caucheteux, A Gramfort, JR King - Scientific reports, 2022 - nature.com
Deep language algorithms, like GPT-2, have demonstrated remarkable abilities to process
text, and now constitute the backbone of automatic translation, summarization and dialogue …