Abstract Natural Language Processing (NLP) is one of the most captivating applications of
Deep Learning. In this survey, we consider how the Data Augmentation training strategy can …

Unlike previous studies on the Metaverse based on Second Life, the current Metaverse is
based on the social value of Generation Z that online and offline selves are not different …

In-context learning is a surprising and important phenomenon that emerged when modern
language models were scaled to billions of learned parameters. Without modifying a large …

The ability to generalize well is one of the primary desiderata for models of natural language
processing (NLP), but what 'good generalization'entails and how it should be evaluated is …

The ability to generalise well is one of the primary desiderata of natural language
processing (NLP). Yet, what'good generalisation'entails and how it should be evaluated is …

This paper introduces Fi ltered C orpus T raining, a method that trains language models
(LMs) on corpora with certain linguistic constructions filtered out from the training data, and …

During language acquisition, children follow a typical sequence of learning stages, whereby
they first learn to categorize phonemes before they develop their lexicon and eventually …

When writing and talking, people sometimes pause to think. Although reasoning-focused
works have often framed reasoning as a method of answering questions or completing …

We investigate the semantic knowledge of language models (LMs), focusing on (1) whether
these LMs create categories of linguistic environments based on their semantic monotonicity …

The usual way to interpret language models (LMs) is to test their performance on different
benchmarks and subsequently infer their internal processes. In this paper, we present an …