Symbols and mental programs: a hypothesis about human singularity
Natural language is often seen as the single factor that explains the cognitive singularity of
the human species. Instead, we propose that humans possess multiple internal languages …
the human species. Instead, we propose that humans possess multiple internal languages …
Evidence of a predictive coding hierarchy in the human brain listening to speech
Considerable progress has recently been made in natural language processing: deep
learning algorithms are increasingly able to generate, summarize, translate and classify …
learning algorithms are increasingly able to generate, summarize, translate and classify …
Toward a realistic model of speech processing in the brain with self-supervised learning
Several deep neural networks have recently been shown to generate activations similar to
those of the brain in response to the same input. These algorithms, however, remain largely …
those of the brain in response to the same input. These algorithms, however, remain largely …
Deep language algorithms predict semantic comprehension from brain activity
Deep language algorithms, like GPT-2, have demonstrated remarkable abilities to process
text, and now constitute the backbone of automatic translation, summarization and dialogue …
text, and now constitute the backbone of automatic translation, summarization and dialogue …
Recursive sequence generation in crows
Recursion, the process of embedding structures within similar structures, is often considered
a foundation of symbolic competence and a uniquely human capability. To understand its …
a foundation of symbolic competence and a uniquely human capability. To understand its …
Mechanisms for handling nested dependencies in neural-network language models and humans
Recursive processing in sentence comprehension is considered a hallmark of human
linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We …
linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We …
Dimensionality and ram**: Signatures of sentence integration in the dynamics of brains and deep language models
A sentence is more than the sum of its words: its meaning depends on how they combine
with one another. The brain mechanisms underlying such semantic composition remain …
with one another. The brain mechanisms underlying such semantic composition remain …
Can transformers process recursive nested constructions, like humans?
Recursive processing is considered a hallmark of human linguistic abilities. A recent study
evaluated recursive processing in recurrent neural language models (RNN-LMs) and …
evaluated recursive processing in recurrent neural language models (RNN-LMs) and …
SLOG: A structural generalization benchmark for semantic parsing
The goal of compositional generalization benchmarks is to evaluate how well models
generalize to new complex linguistic expressions. Existing benchmarks often focus on …
generalize to new complex linguistic expressions. Existing benchmarks often focus on …
Long-range and hierarchical language predictions in brains and algorithms
Deep learning has recently made remarkable progress in natural language processing. Yet,
the resulting algorithms remain far from competing with the language abilities of the human …
the resulting algorithms remain far from competing with the language abilities of the human …