Chart question answering: State of the art and future directions

E Hoque, P Kavehzadeh, A Masry - Computer Graphics Forum, 2022 - Wiley Online Library
Abstract Information visualizations such as bar charts and line charts are very common for
analyzing data and discovering critical insights. Often people analyze charts to answer …

Graphologue: Exploring large language model responses with interactive diagrams

P Jiang, J Rayan, SP Dow, H **a - Proceedings of the 36th annual ACM …, 2023 - dl.acm.org
Large language models (LLMs) have recently soared in popularity due to their ease of
access and the unprecedented ability to synthesize text responses to diverse user …

Vistext: A benchmark for semantically rich chart captioning

BJ Tang, A Boggust, A Satyanarayan - arxiv preprint arxiv:2307.05356, 2023 - arxiv.org
Captions that describe or explain charts help improve recall and comprehension of the
depicted data and provide a more accessible medium for people with visual disabilities …

Accessible visualization via natural language descriptions: A four-level model of semantic content

A Lundgard, A Satyanarayan - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Natural language descriptions sometimes accompany visualizations to better communicate
and contextualize their insights, and to improve their accessibility for readers with …

Natural language dataset generation framework for visualizations powered by large language models

HK Ko, H Jeon, G Park, DH Kim, NW Kim… - Proceedings of the …, 2024 - dl.acm.org
We introduce VL2NL, a Large Language Model (LLM) framework that generates rich and
diverse NL datasets using Vega-Lite specifications as input, thereby streamlining the …

Data player: Automatic generation of data videos with narration-animation interplay

L Shen, Y Zhang, H Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Data visualizations and narratives are often integrated to convey data stories effectively.
Among various data storytelling formats, data videos have been garnering increasing …

Citesee: Augmenting citations in scientific papers with persistent and personalized historical context

JC Chang, AX Zhang, J Bragg, A Head, K Lo… - Proceedings of the …, 2023 - dl.acm.org
When reading a scholarly article, inline citations help researchers contextualize the current
article and discover relevant prior work. However, it can be challenging to prioritize and …

Kori: Interactive synthesis of text and charts in data documents

S Latif, Z Zhou, Y Kim, F Beck… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Charts go hand in hand with text to communicate complex data and are widely adopted in
news articles, online blogs, and academic papers. They provide graphical summaries of the …

Answering questions about charts and generating visual explanations

DH Kim, E Hoque, M Agrawala - … of the 2020 CHI conference on human …, 2020 - dl.acm.org
People often use charts to analyze data, answer questions and explain their answers to
others. In a formative study, we find that such human-generated questions and explanations …

Augmenting scientific papers with just-in-time, position-sensitive definitions of terms and symbols

A Head, K Lo, D Kang, R Fok, S Skjonsberg… - Proceedings of the …, 2021 - dl.acm.org
Despite the central importance of research papers to scientific progress, they can be difficult
to read. Comprehension is often stymied when the information needed to understand a …