A survey of controllable text generation using transformer-based pre-trained language models

H Zhang, H Song, S Li, M Zhou, D Song - ACM Computing Surveys, 2023 - dl.acm.org
Controllable Text Generation (CTG) is an emerging area in the field of natural language
generation (NLG). It is regarded as crucial for the development of advanced text generation …

Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

A contrastive framework for neural text generation

Y Su, T Lan, Y Wang, D Yogatama… - Advances in Neural …, 2022 - proceedings.neurips.cc
Text generation is of great importance to many natural language processing applications.
However, maximization-based decoding methods (eg, beam search) of neural language …

Songmass: Automatic song writing with pre-training and alignment constraint

Z Sheng, K Song, X Tan, Y Ren, W Ye… - Proceedings of the …, 2021 - ojs.aaai.org
Automatic song writing aims to compose a song (lyric and/or melody) by machine, which is
an interesting topic in both academia and industry. In automatic song writing, lyric-to-melody …

DeepRapper: Neural rap generation with rhyme and rhythm modeling

L Xue, K Song, D Wu, X Tan, NL Zhang, T Qin… - arxiv preprint arxiv …, 2021 - arxiv.org
Rap generation, which aims to produce lyrics and corresponding singing beats, needs to
model both rhymes and rhythms. Previous works for rap generation focused on rhyming …

Telemelody: Lyric-to-melody generation with a template-based two-stage method

Z Ju, P Lu, X Tan, R Wang, C Zhang, S Wu… - arxiv preprint arxiv …, 2021 - arxiv.org
Lyric-to-melody generation is an important task in automatic songwriting. Previous lyric-to-
melody generation systems usually adopt end-to-end models that directly generate …

[PDF][PDF] On the power of special-purpose GPT models to create and evaluate new poetry in old styles

P Sawicki, M Grzes, LF Góes, D Brown, M Peeperkorn… - 2023 - figshare.le.ac.uk
ThisstudyinvestigatesthepossibilityofusingG…-3 modelstogeneratehigh-
qualitypoemsinaspecificauthor'sstyle, throughfine-tuningondatasetsofpoems accompaniedbytheirmetadataandautomatic …

Relyme: Improving lyric-to-melody generation by incorporating lyric-melody relationships

C Zhang, L Chang, S Wu, X Tan, T Qin, TY Liu… - Proceedings of the 30th …, 2022 - dl.acm.org
Lyric-to-melody generation, which generates melody according to given lyrics, is one of the
most important automatic music composition tasks. With the rapid development of deep …

A sentiment and style controllable approach for chinese poetry generation

Y Shao, T Shao, M Wang, P Wang, J Gao - Proceedings of the 30th ACM …, 2021 - dl.acm.org
Sentiment and style control are two vital aspects in automatic poetry generation. Excellent
Chinese classical poetry should express a certain emotion and embody a specific style at …

Hierarchical template transformer for fine-grained sentiment controllable generation

L Yuan, J Wang, LC Yu, X Zhang - Information Processing & Management, 2022 - Elsevier
Existing methods for text generation usually fed the overall sentiment polarity of a product as
an input into the seq2seq model to generate a relatively fluent review. However, these …