Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Few-shot learning for medical text: A review of advances, trends, and opportunities

Y Ge, Y Guo, S Das, MA Al-Garadi, A Sarker - Journal of Biomedical …, 2023 - Elsevier
Background: Few-shot learning (FSL) is a class of machine learning methods that require
small numbers of labeled instances for training. With many medical topics having limited …

BioSeq-BLM: a platform for analyzing DNA, RNA and protein sequences based on biological language models

HL Li, YH Pang, B Liu - Nucleic acids research, 2021 - academic.oup.com
In order to uncover the meanings of 'book of life', 155 different biological language models
(BLMs) for DNA, RNA and protein sequence analysis are discussed in this study, which are …

Text-to-text pre-training for data-to-text tasks

M Kale, A Rastogi - arxiv preprint arxiv:2005.10433, 2020 - arxiv.org
We study the pre-train+ fine-tune strategy for data-to-text tasks. Our experiments indicate that
text-to-text pre-training in the form of T5, enables simple, end-to-end transformer based …

Dart: Open-domain structured data record to text generation

L Nan, D Radev, R Zhang, A Rau, A Sivaprasad… - arxiv preprint arxiv …, 2020 - arxiv.org
We present DART, an open domain structured DAta Record to Text generation dataset with
over 82k instances (DARTs). Data-to-Text annotations can be a costly process, especially …

A survey on recent advances in llm-based multi-turn dialogue systems

Z Yi, J Ouyang, Y Liu, T Liao, Z Xu, Y Shen - arxiv preprint arxiv …, 2024 - arxiv.org
This survey provides a comprehensive review of research on multi-turn dialogue systems,
with a particular focus on multi-turn dialogue systems based on large language models …

Scientometric review of artificial intelligence for operations & maintenance of wind turbines: The past, present and future

J Chatterjee, N Dethlefs - Renewable and Sustainable Energy Reviews, 2021 - Elsevier
Wind energy has emerged as a highly promising source of renewable energy in recent
times. However, wind turbines regularly suffer from operational inconsistencies, leading to …

Transformers for tabular data representation: A survey of models and applications

G Badaro, M Saeed, P Papotti - Transactions of the Association for …, 2023 - direct.mit.edu
In the last few years, the natural language processing community has witnessed advances
in neural representations of free texts with transformer-based language models (LMs). Given …

KGPT: Knowledge-grounded pre-training for data-to-text generation

W Chen, Y Su, X Yan, WY Wang - arxiv preprint arxiv:2010.02307, 2020 - arxiv.org
Data-to-text generation has recently attracted substantial interests due to its wide
applications. Existing methods have shown impressive performance on an array of tasks …

State-of-the-art generalisation research in NLP: a taxonomy and review

D Hupkes, M Giulianelli, V Dankers, M Artetxe… - arxiv preprint arxiv …, 2022 - arxiv.org
The ability to generalise well is one of the primary desiderata of natural language
processing (NLP). Yet, what'good generalisation'entails and how it should be evaluated is …