A survey of natural language generation

C Dong, Y Li, H Gong, M Chen, J Li, Y Shen… - ACM Computing …, 2022‏ - dl.acm.org
This article offers a comprehensive review of the research on Natural Language Generation
(NLG) over the past two decades, especially in relation to data-to-text generation and text-to …

Storytelling with image data: A systematic review and comparative analysis of methods and tools

F Lotfi, A Beheshti, H Farhood, M Pooshideh… - Algorithms, 2023‏ - mdpi.com
In our digital age, data are generated constantly from public and private sources, social
media platforms, and the Internet of Things. A significant portion of this information comes in …

Knowledge-enriched attention network with group-wise semantic for visual storytelling

T Li, H Wang, B He, CW Chen - IEEE Transactions on Pattern …, 2022‏ - ieeexplore.ieee.org
As a technically challenging topic, visual storytelling aims at generating an imaginary and
coherent story with narrative multi-sentences from a group of relevant images. Existing …

BERT-hLSTMs: BERT and hierarchical LSTMs for visual storytelling

J Su, Q Dai, F Guerin, M Zhou - Computer speech & language, 2021‏ - Elsevier
Visual storytelling is a creative and challenging task, aiming to automatically generate a
story-like description for a sequence of images. The descriptions generated by previous …

Latent memory-augmented graph transformer for visual storytelling

M Qi, J Qin, D Huang, Z Shen, Y Yang… - Proceedings of the 29th …, 2021‏ - dl.acm.org
Visual storytelling aims to automatically generate a human-like short story given an image
stream. Most existing works utilize either scene-level or object-level representations …

Two heads are better than one: Hypergraph-enhanced graph reasoning for visual event ratiocination

W Zheng, L Yan, C Gou… - … Conference on Machine …, 2021‏ - proceedings.mlr.press
Even with a still image, humans can ratiocinate various visual cause-and-effect descriptions
before, at present, and after, as well as beyond the given image. However, it is challenging …

Coherent visual storytelling via parallel top-down visual and topic attention

J Gu, H Wang, R Fan - … on Circuits and Systems for Video …, 2022‏ - ieeexplore.ieee.org
Visual storytelling aims at producing a narrative paragraph for a given photo album
automatically. It introduces more new challenges than individual image paragraph …

Context-aware Visual Storytelling with Visual Prefix Tuning and Contrastive Learning

Y Song, D Paperno, A Gatt - arxiv preprint arxiv:2408.06259, 2024‏ - arxiv.org
Visual storytelling systems generate multi-sentence stories from image sequences. In this
task, capturing contextual information and bridging visual variation bring additional …

Text-only training for visual storytelling

Y Wang, W Zhou, Z Lu, H Li - Proceedings of the 31st ACM International …, 2023‏ - dl.acm.org
Visual storytelling aims to generate a narrative based on a sequence of images,
necessitating both vision-language alignment and coherent story generation. Most existing …

Sentistory: A multi-layered sentiment-aware generative model for visual storytelling

W Chen, X Liu, J Niu - … on Circuits and Systems for Video …, 2022‏ - ieeexplore.ieee.org
The visual storytelling (VIST) task aims at generating reasonable, human-like and coherent
stories with the image streams as input. Although many deep learning models have …