Emergent multi-agent communication in the deep learning era

A Lazaridou, M Baroni - arxiv preprint arxiv:2006.02419, 2020 - arxiv.org
The ability to cooperate through language is a defining feature of humans. As the
perceptual, motory and planning capabilities of deep artificial networks increase …

Experience grounds language

Y Bisk, A Holtzman, J Thomason, J Andreas… - arxiv preprint arxiv …, 2020 - arxiv.org
Language understanding research is held back by a failure to relate language to the
physical world it describes and to the social interactions it facilitates. Despite the incredible …

Towards principled disentanglement for domain generalization

H Zhang, YF Zhang, W Liu, A Weller… - Proceedings of the …, 2022 - openaccess.thecvf.com
A fundamental challenge for machine learning models is generalizing to out-of-distribution
(OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize …

Learning from teaching regularization: Generalizable correlations should be easy to imitate

C **, T Che, H Peng, Y Li, DN Metaxas… - arxiv preprint arxiv …, 2024 - arxiv.org
Generalization remains a central challenge in machine learning. In this work, we propose
Learning from Teaching (LoT), a novel regularization technique for deep neural networks to …

Compositional generalization in unsupervised compositional representation learning: A study on disentanglement and emergent language

Z Xu, M Niethammer, CA Raffel - Advances in Neural …, 2022 - proceedings.neurips.cc
Deep learning models struggle with compositional generalization, ie the ability to recognize
or generate novel combinations of observed elementary concepts. In hopes of enabling …

Emergent communication at scale

R Chaabouni, F Strub, F Altché, E Tarassov… - International …, 2022 - openreview.net
Emergent communication aims for a better understanding of human language evolution and
building more efficient representations. We posit that reaching these goals will require …

Iterated learning improves compositionality in large vision-language models

C Zheng, J Zhang, A Kembhavi… - Proceedings of the …, 2024 - openaccess.thecvf.com
A fundamental characteristic common to both human vision and natural language is their
compositional nature. Yet despite the performance gains contributed by large vision and …

Meta-learning to compositionally generalize

H Conklin, B Wang, K Smith, I Titov - arxiv preprint arxiv:2106.04252, 2021 - arxiv.org
Natural language is compositional; the meaning of a sentence is a function of the meaning
of its parts. This property allows humans to create and interpret novel sentences …

Compositionality in computational linguistics

L Donatelli, A Koller - Annual Review of Linguistics, 2023 - annualreviews.org
Neural models greatly outperform grammar-based models across many tasks in modern
computational linguistics. This raises the question of whether linguistic principles, such as …

The role of disentanglement in generalisation

ML Montero, CJH Ludwig, RP Costa… - International …, 2020 - openreview.net
Combinatorial generalisation—the ability to understand and produce novel combinations of
familiar elements—is a core capacity of human intelligence that current AI systems struggle …