Pre-trained language models for text generation: A survey

J Li, T Tang, WX Zhao, JY Nie, JR Wen - ACM Computing Surveys, 2024 - dl.acm.org
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …

Unifying large language models and knowledge graphs: A roadmap

S Pan, L Luo, Y Wang, C Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the
field of natural language processing and artificial intelligence, due to their emergent ability …

A comprehensive survey of graph neural networks for knowledge graphs

Z Ye, YJ Kumar, GO Sing, F Song, J Wang - IEEE Access, 2022 - ieeexplore.ieee.org
The Knowledge graph, a multi-relational graph that represents rich factual information
among entities of diverse classifications, has gradually become one of the critical tools for …

Transformers for tabular data representation: A survey of models and applications

G Badaro, M Saeed, P Papotti - Transactions of the Association for …, 2023 - direct.mit.edu
In the last few years, the natural language processing community has witnessed advances
in neural representations of free texts with transformer-based language models (LMs). Given …

A systematic literature review on text generation using deep neural network models

N Fatima, AS Imran, Z Kastrati, SM Daudpota… - IEEE …, 2022 - ieeexplore.ieee.org
In recent years, significant progress has been made in text generation. The latest text
generation models are revolutionizing the domain by generating human-like text. It has …

Using large language models for zero-shot natural language generation from knowledge graphs

A Axelsson, G Skantze - arxiv preprint arxiv:2307.07312, 2023 - arxiv.org
In any system that uses structured knowledge graph (KG) data as its underlying knowledge
representation, KG-to-text generation is a useful tool for turning parts of the graph data into …

Do you follow? a fully automated system for adaptive robot presenters

A Axelsson, G Skantze - Proceedings of the 2023 acm/ieee international …, 2023 - dl.acm.org
An interesting application for social robots is to act as a presenter, for example as a museum
guide. In this paper, we present a fully automated system architecture for building adaptive …

Learning to transfer prompts for text generation

J Li, T Tang, JY Nie, JR Wen, WX Zhao - arxiv preprint arxiv:2205.01543, 2022 - arxiv.org
Pretrained language models (PLMs) have made remarkable progress in text generation
tasks via fine-tuning. While, it is challenging to fine-tune PLMs in a data-scarce situation …

Evaluating generative models for graph-to-text generation

S Yuan, M Färber - arxiv preprint arxiv:2307.14712, 2023 - arxiv.org
Large language models (LLMs) have been widely employed for graph-to-text generation
tasks. However, the process of finetuning LLMs requires significant training resources and …

ASDOT: Any-shot data-to-text generation with pretrained language models

J **ang, Z Liu, Y Zhou, EP **ng, Z Hu - arxiv preprint arxiv:2210.04325, 2022 - arxiv.org
Data-to-text generation is challenging due to the great variety of the input data in terms of
domains (eg, finance vs sports) or schemata (eg, diverse predicates). Recent end-to-end …