A survey of controllable text generation using transformer-based pre-trained language models
Controllable Text Generation (CTG) is an emerging area in the field of natural language
generation (NLG). It is regarded as crucial for the development of advanced text generation …
generation (NLG). It is regarded as crucial for the development of advanced text generation …
A survey of natural language generation
This article offers a comprehensive review of the research on Natural Language Generation
(NLG) over the past two decades, especially in relation to data-to-text generation and text-to …
(NLG) over the past two decades, especially in relation to data-to-text generation and text-to …
Pretraining language models with human preferences
Abstract Language models (LMs) are pretrained to imitate text from large and diverse
datasets that contain content that would violate human preferences if generated by an LM …
datasets that contain content that would violate human preferences if generated by an LM …
Is chatgpt a good nlg evaluator? a preliminary study
Recently, the emergence of ChatGPT has attracted wide attention from the computational
linguistics community. Many prior studies have shown that ChatGPT achieves remarkable …
linguistics community. Many prior studies have shown that ChatGPT achieves remarkable …
Lamda: Language models for dialog applications
We present LaMDA: Language Models for Dialog Applications. LaMDA is a family of
Transformer-based neural language models specialized for dialog, which have up to 137B …
Transformer-based neural language models specialized for dialog, which have up to 137B …
Measuring and narrowing the compositionality gap in language models
We investigate the ability of language models to perform compositional reasoning tasks
where the overall solution depends on correctly composing the answers to sub-problems …
where the overall solution depends on correctly composing the answers to sub-problems …
Coauthor: Designing a human-ai collaborative writing dataset for exploring language model capabilities
Large language models (LMs) offer unprecedented language generation capabilities and
exciting opportunities for interaction design. However, their highly context-dependent …
exciting opportunities for interaction design. However, their highly context-dependent …
Human–AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support
Advances in artificial intelligence (AI) are enabling systems that augment and collaborate
with humans to perform simple, mechanistic tasks such as scheduling meetings and …
with humans to perform simple, mechanistic tasks such as scheduling meetings and …
Contrastive decoding: Open-ended text generation as optimization
Given a language model (LM), maximum probability is a poor decoding objective for open-
ended generation, because it produces short and repetitive text. On the other hand …
ended generation, because it produces short and repetitive text. On the other hand …
Calibrate before use: Improving few-shot performance of language models
GPT-3 can perform numerous tasks when provided a natural language prompt that contains
a few training examples. We show that this type of few-shot learning can be unstable: the …
a few training examples. We show that this type of few-shot learning can be unstable: the …