Emergent multi-agent communication in the deep learning era

A Lazaridou, M Baroni - arxiv preprint arxiv:2006.02419, 2020 - arxiv.org
The ability to cooperate through language is a defining feature of humans. As the
perceptual, motory and planning capabilities of deep artificial networks increase …

Simplicity and specificity in language: Domain-general biases have domain-specific effects

J Culbertson, S Kirby - Frontiers in psychology, 2016 - frontiersin.org
The extent to which the linguistic system—its architecture, the representations it operates on,
the constraints it is subject to—is specific to language has broad implications for cognitive …

Emergence of linguistic communication from referential games with symbolic and pixel input

A Lazaridou, KM Hermann, K Tuyls, S Clark - arxiv preprint arxiv …, 2018 - arxiv.org
The ability of algorithms to evolve or learn (compositional) communication protocols has
traditionally been studied in the language evolution literature through the use of emergent …

Compositional generalization in unsupervised compositional representation learning: A study on disentanglement and emergent language

Z Xu, M Niethammer, CA Raffel - Advances in Neural …, 2022 - proceedings.neurips.cc
Deep learning models struggle with compositional generalization, ie the ability to recognize
or generate novel combinations of observed elementary concepts. In hopes of enabling …

Compositionality and generalization in emergent languages

R Chaabouni, E Kharitonov, D Bouchacourt… - arxiv preprint arxiv …, 2020 - arxiv.org
Natural language allows us to refer to novel composite concepts by combining expressions
denoting their parts according to systematic rules, a property known as\emph …

Emergent communication at scale

R Chaabouni, F Strub, F Altché, E Tarassov… - International …, 2022 - openreview.net
Emergent communication aims for a better understanding of human language evolution and
building more efficient representations. We posit that reaching these goals will require …

Measuring compositionality in representation learning

J Andreas - arxiv preprint arxiv:1902.07181, 2019 - arxiv.org
Many machine learning algorithms represent input data with vector embeddings or discrete
codes. When inputs exhibit compositional structure (eg objects built from parts or procedures …

Improving compositional generalization using iterated learning and simplicial embeddings

Y Ren, S Lavoie, M Galkin… - Advances in …, 2024 - proceedings.neurips.cc
Compositional generalization, the ability of an agent to generalize to unseen combinations
of latent factors, is easy for humans but hard for deep neural networks. A line of research in …

LexSym: Compositionality as lexical symmetry

E Akyürek, J Andreas - Proceedings of the 61st Annual Meeting of …, 2023 - aclanthology.org
In tasks like semantic parsing, instruction following, and question answering, standard deep
networks fail to generalize compositionally from small datasets. Many existing approaches …

Iterated learning improves compositionality in large vision-language models

C Zheng, J Zhang, A Kembhavi… - Proceedings of the …, 2024 - openaccess.thecvf.com
A fundamental characteristic common to both human vision and natural language is their
compositional nature. Yet despite the performance gains contributed by large vision and …