Emergent multi-agent communication in the deep learning era
The ability to cooperate through language is a defining feature of humans. As the
perceptual, motory and planning capabilities of deep artificial networks increase …
perceptual, motory and planning capabilities of deep artificial networks increase …
Simplicity and specificity in language: Domain-general biases have domain-specific effects
The extent to which the linguistic system—its architecture, the representations it operates on,
the constraints it is subject to—is specific to language has broad implications for cognitive …
the constraints it is subject to—is specific to language has broad implications for cognitive …
Emergence of linguistic communication from referential games with symbolic and pixel input
The ability of algorithms to evolve or learn (compositional) communication protocols has
traditionally been studied in the language evolution literature through the use of emergent …
traditionally been studied in the language evolution literature through the use of emergent …
Compositional generalization in unsupervised compositional representation learning: A study on disentanglement and emergent language
Deep learning models struggle with compositional generalization, ie the ability to recognize
or generate novel combinations of observed elementary concepts. In hopes of enabling …
or generate novel combinations of observed elementary concepts. In hopes of enabling …
Compositionality and generalization in emergent languages
Natural language allows us to refer to novel composite concepts by combining expressions
denoting their parts according to systematic rules, a property known as\emph …
denoting their parts according to systematic rules, a property known as\emph …
Emergent communication at scale
Emergent communication aims for a better understanding of human language evolution and
building more efficient representations. We posit that reaching these goals will require …
building more efficient representations. We posit that reaching these goals will require …
Measuring compositionality in representation learning
J Andreas - arxiv preprint arxiv:1902.07181, 2019 - arxiv.org
Many machine learning algorithms represent input data with vector embeddings or discrete
codes. When inputs exhibit compositional structure (eg objects built from parts or procedures …
codes. When inputs exhibit compositional structure (eg objects built from parts or procedures …
Improving compositional generalization using iterated learning and simplicial embeddings
Compositional generalization, the ability of an agent to generalize to unseen combinations
of latent factors, is easy for humans but hard for deep neural networks. A line of research in …
of latent factors, is easy for humans but hard for deep neural networks. A line of research in …
LexSym: Compositionality as lexical symmetry
In tasks like semantic parsing, instruction following, and question answering, standard deep
networks fail to generalize compositionally from small datasets. Many existing approaches …
networks fail to generalize compositionally from small datasets. Many existing approaches …
Iterated learning improves compositionality in large vision-language models
A fundamental characteristic common to both human vision and natural language is their
compositional nature. Yet despite the performance gains contributed by large vision and …
compositional nature. Yet despite the performance gains contributed by large vision and …