Symbols and mental programs: a hypothesis about human singularity

S Dehaene, F Al Roumi, Y Lakretz, S Planton… - Trends in Cognitive …, 2022 - cell.com
Natural language is often seen as the single factor that explains the cognitive singularity of
the human species. Instead, we propose that humans possess multiple internal languages …

Evidence of a predictive coding hierarchy in the human brain listening to speech

C Caucheteux, A Gramfort, JR King - Nature human behaviour, 2023 - nature.com
Considerable progress has recently been made in natural language processing: deep
learning algorithms are increasingly able to generate, summarize, translate and classify …

Toward a realistic model of speech processing in the brain with self-supervised learning

J Millet, C Caucheteux, Y Boubenec… - Advances in …, 2022 - proceedings.neurips.cc
Several deep neural networks have recently been shown to generate activations similar to
those of the brain in response to the same input. These algorithms, however, remain largely …

Deep language algorithms predict semantic comprehension from brain activity

C Caucheteux, A Gramfort, JR King - Scientific reports, 2022 - nature.com
Deep language algorithms, like GPT-2, have demonstrated remarkable abilities to process
text, and now constitute the backbone of automatic translation, summarization and dialogue …

Recursive sequence generation in crows

DA Liao, KF Brecht, M Johnston, A Nieder - Science Advances, 2022 - science.org
Recursion, the process of embedding structures within similar structures, is often considered
a foundation of symbolic competence and a uniquely human capability. To understand its …

Mechanisms for handling nested dependencies in neural-network language models and humans

Y Lakretz, D Hupkes, A Vergallito, M Marelli, M Baroni… - Cognition, 2021 - Elsevier
Recursive processing in sentence comprehension is considered a hallmark of human
linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We …

Dimensionality and ram**: Signatures of sentence integration in the dynamics of brains and deep language models

T Desbordes, Y Lakretz, V Chanoine… - Journal of …, 2023 - Soc Neuroscience
A sentence is more than the sum of its words: its meaning depends on how they combine
with one another. The brain mechanisms underlying such semantic composition remain …

Can transformers process recursive nested constructions, like humans?

Y Lakretz, T Desbordes, D Hupkes… - Proceedings of the 29th …, 2022 - aclanthology.org
Recursive processing is considered a hallmark of human linguistic abilities. A recent study
evaluated recursive processing in recurrent neural language models (RNN-LMs) and …

SLOG: A structural generalization benchmark for semantic parsing

B Li, L Donatelli, A Koller, T Linzen, Y Yao… - arxiv preprint arxiv …, 2023 - arxiv.org
The goal of compositional generalization benchmarks is to evaluate how well models
generalize to new complex linguistic expressions. Existing benchmarks often focus on …

Long-range and hierarchical language predictions in brains and algorithms

C Caucheteux, A Gramfort, JR King - arxiv preprint arxiv:2111.14232, 2021 - arxiv.org
Deep learning has recently made remarkable progress in natural language processing. Yet,
the resulting algorithms remain far from competing with the language abilities of the human …