KaggleDBQA: Realistic evaluation of text-to-SQL parsers

CH Lee, O Polozov, M Richardson - arxiv preprint arxiv:2106.11455, 2021 - arxiv.org
The goal of database question answering is to enable natural language querying of real-life
relational databases in diverse application domains. Recently, large-scale datasets such as …

Ehrsql: A practical text-to-sql benchmark for electronic health records

G Lee, H Hwang, S Bae, Y Kwon… - Advances in …, 2022 - proceedings.neurips.cc
We present a new text-to-SQL dataset for electronic health records (EHRs). The utterances
were collected from 222 hospital staff, including physicians, nurses, insurance review and …

Data ambiguity strikes back: How documentation improves gpt's text-to-sql

Z Huang, PK Damalapati, E Wu - arxiv preprint arxiv:2310.18742, 2023 - arxiv.org
Text-to-SQL allows experts to use databases without in-depth knowledge of them. However,
real-world tasks have both query and data ambiguities. Most works on Text-to-SQL focused …

Deep learning driven natural languages text to SQL query conversion: a survey

A Kumar, P Nagarkar, P Nalhe… - arxiv preprint arxiv …, 2022 - arxiv.org
With the future striving toward data-centric decision-making, seamless access to databases
is of utmost importance. There is extensive research on creating an efficient text-to-sql …

Towards unbiased evaluation of detecting unanswerable questions in EHRSQL

Y Yang, S Kim, SM Kim, G Lee, SY Yun… - arxiv preprint arxiv …, 2024 - arxiv.org
Incorporating unanswerable questions into EHR QA systems is crucial for testing the
trustworthiness of a system, as providing non-existent responses can mislead doctors in …

TrustSQL: Benchmarking Text-to-SQL Reliability with Penalty-Based Scoring

G Lee, W Chay, S Cho, E Choi - arxiv preprint arxiv:2403.15879, 2024 - arxiv.org
Text-to-SQL enables users to interact with databases using natural language, simplifying the
retrieval and synthesis of information. Despite the remarkable success of large language …

Nl2interface: Interactive visualization interface generation from natural language queries

Y Chen, R Li, A Mac, T **e, T Yu, E Wu - arxiv preprint arxiv:2209.08834, 2022 - arxiv.org
We develop NL2INTERFACE to explore the potential of generating usable interactive multi-
visualization interfaces from natural language queries. With NL2INTERFACE, users can …

QDA-SQL: questions enhanced dialogue augmentation for multi-turn text-to-SQL

Y Sun, Z Guo, H Yu, C Liu, X Li, B Wang, X Yu… - arxiv preprint arxiv …, 2024 - arxiv.org
Fine-tuning large language models (LLMs) for specific domain tasks has achieved great
success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with …

[책][B] Natural language interfaces to databases

Y Li, D Radev, D Rafiei - 2024 - Springer
In the ever-expanding realm of data-driven exploration and decision-making, the ability to
harness the power of natural language to interact with databases has become an …

PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queries

M Dong, NA Kumar, Y Hu, A Chauhan… - arxiv preprint arxiv …, 2024 - arxiv.org
Previous text-to-SQL datasets and systems have primarily focused on user questions with
clear intentions that can be answered. However, real user questions can often be …