Can llm already serve as a database interface? a big bench for large-scale database grounded text-to-sqls

J Li, B Hui, G Qu, J Yang, B Li, B Li… - Advances in …, 2024 - proceedings.neurips.cc
Text-to-SQL parsing, which aims at converting natural language instructions into executable
SQLs, has gained increasing attention in recent years. In particular, GPT-4 and Claude-2 …

Ehragent: Code empowers large language models for few-shot complex tabular reasoning on electronic health records

W Shi, R Xu, Y Zhuang, Y Yu, J Zhang… - Proceedings of the …, 2024 - aclanthology.org
Clinicians often rely on data engineers to retrieve complex patient information from
electronic health record (EHR) systems, a process that is both inefficient and time …

Ehrxqa: A multi-modal question answering dataset for electronic health records with chest x-ray images

S Bae, D Kyung, J Ryu, E Cho, G Lee… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Electronic Health Records (EHRs), which contain patients' medical histories in
various multi-modal formats, often overlook the potential for joint reasoning across imaging …

Ehragent: Code empowers large language models for complex tabular reasoning on electronic health records

W Shi, R Xu, Y Zhuang, Y Yu, J Zhang, H Wu… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) have demonstrated exceptional capabilities in planning and
tool utilization as autonomous agents, but few have been developed for medical problem …

Trustsql: A reliability benchmark for text-to-sql models with diverse unanswerable questions

G Lee, W Chay, S Cho, E Choi - arxiv preprint arxiv:2403.15879, 2024 - arxiv.org
Recent advances in large language models (LLMs) have led to significant improvements in
translating natural language questions into SQL queries. While achieving high accuracy in …

Ecg-qa: A comprehensive question answering dataset combined with electrocardiogram

J Oh, G Lee, S Bae, J Kwon… - Advances in Neural …, 2024 - proceedings.neurips.cc
Question answering (QA) in the field of healthcare has received much attention due to
significant advancements in natural language processing. However, existing healthcare QA …

Overview of the ehrsql 2024 shared task on reliable text-to-sql modeling on electronic health records

G Lee, S Kweon, S Bae, E Choi - arxiv preprint arxiv:2405.06673, 2024 - arxiv.org
Electronic Health Records (EHRs) are relational databases that store the entire medical
histories of patients within hospitals. They record numerous aspects of patients' medical …

Trojansql: Sql injection against natural language interface to database

J Zhang, Y Zhou, B Hui, Y Liu, Z Li… - Proceedings of the 2023 …, 2023 - aclanthology.org
The technology of text-to-SQL has significantly enhanced the efficiency of accessing and
manipulating databases. However, limited research has been conducted to study its …

Multisql: A schema-integrated context-dependent text2sql dataset with diverse sql operations

C Li, Y Wang, Z Wu, Z Yu, F Zhao… - Findings of the …, 2024 - aclanthology.org
Text2SQL is a task that translates natural language into SQL statements. Context-dependent
Text2SQL offers a more natural database interaction by simulating dialogues between users …

Benchmarking and improving text-to-sql generation under ambiguity

A Bhaskar, T Tomar, A Sathe, S Sarawagi - arxiv preprint arxiv …, 2023 - arxiv.org
Research in Text-to-SQL conversion has been largely benchmarked against datasets where
each text query corresponds to one correct SQL. However, natural language queries over …