Human-like systematic generalization through a meta-learning neural network

BM Lake, M Baroni - Nature, 2023 - nature.com
The power of human language and thought arises from systematic compositionality—the
algebraic ability to understand and produce novel combinations from known components …

What artificial neural networks can tell us about human language acquisition

A Warstadt, SR Bowman - Algebraic structures in natural …, 2022 - taylorfrancis.com
Rapid progress in machine learning for natural language processing has the potential to
transform debates about how humans learn language. However, the learning environments …

[PDF][PDF] Deep learning needs a prefrontal cortex

J Russin, RC O'Reilly, Y Bengio - Work Bridging AI Cogn …, 2020 - baicsworkshop.github.io
Research seeking to build artificial systems capable of reproducing elements of human
intelligence may benefit from a deeper consideration of the architecture and learning …

Compositional generalization and natural language variation: Can a semantic parsing approach handle both?

P Shaw, MW Chang, P Pasupat… - arxiv preprint arxiv …, 2020 - arxiv.org
Sequence-to-sequence models excel at handling natural language variation, but have been
shown to struggle with out-of-distribution compositional generalization. This has motivated …

Good-enough compositional data augmentation

J Andreas - arxiv preprint arxiv:1904.09545, 2019 - arxiv.org
We propose a simple data augmentation protocol aimed at providing a compositional
inductive bias in conditional and unconditional sequence models. Under this protocol …

Compositional generalization through meta sequence-to-sequence learning

BM Lake - Advances in neural information processing …, 2019 - proceedings.neurips.cc
People can learn a new concept and use it compositionally, understanding how to" blicket
twice" after learning how to" blicket." In contrast, powerful sequence-to-sequence (seq2seq) …

A survey on compositional generalization in applications

B Lin, D Bouneffouf, I Rish - arxiv preprint arxiv:2302.01067, 2023 - arxiv.org
The field of compositional generalization is currently experiencing a renaissance in AI, as
novel problem settings and algorithms motivated by various practical applications are being …

A benchmark for systematic generalization in grounded language understanding

L Ruis, J Andreas, M Baroni… - Advances in neural …, 2020 - proceedings.neurips.cc
Humans easily interpret expressions that describe unfamiliar situations composed from
familiar parts (" greet the pink brontosaurus by the ferris wheel"). Modern neural networks, by …

Bridging the gulf of envisioning: Cognitive challenges in prompt based interactions with LLMs

H Subramonyam, R Pea, C Pondoc… - Proceedings of the …, 2024 - dl.acm.org
Large language models (LLMs) exhibit dynamic capabilities and appear to comprehend
complex and ambiguous natural language prompts. However, calibrating LLM interactions is …

The paradox of the compositionality of natural language: A neural machine translation case study

V Dankers, E Bruni, D Hupkes - arxiv preprint arxiv:2108.05885, 2021 - arxiv.org
Obtaining human-like performance in NLP is often argued to require compositional
generalisation. Whether neural networks exhibit this ability is usually studied by training …