[HTML][HTML] A survey of GPT-3 family large language models including ChatGPT and GPT-4

KS Kalyan - Natural Language Processing Journal, 2024 - Elsevier
Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …

Leak, cheat, repeat: Data contamination and evaluation malpractices in closed-source llms

S Balloccu, P Schmidtová, M Lango… - arxiv preprint arxiv …, 2024 - arxiv.org
Natural Language Processing (NLP) research is increasingly focusing on the use of Large
Language Models (LLMs), with some of the most popular ones being either fully or partially …

A survey on knowledge distillation of large language models

X Xu, M Li, C Tao, T Shen, R Cheng, J Li, C Xu… - arxiv preprint arxiv …, 2024 - arxiv.org
This survey presents an in-depth exploration of knowledge distillation (KD) techniques
within the realm of Large Language Models (LLMs), spotlighting the pivotal role of KD in …

BioInstruct: instruction tuning of large language models for biomedical natural language processing

H Tran, Z Yang, Z Yao, H Yu - Journal of the American Medical …, 2024 - academic.oup.com
Objectives To enhance the performance of large language models (LLMs) in biomedical
natural language processing (BioNLP) by introducing a domain-specific instruction dataset …

Paniniqa: Enhancing patient education through interactive question answering

P Cai, Z Yao, F Liu, D Wang, M Reilly… - Transactions of the …, 2023 - direct.mit.edu
A patient portal allows discharged patients to access their personalized discharge
instructions in electronic health records (EHRs). However, many patients have difficulty …

Improving summarization with human edits

Z Yao, BJ Schloss, SP Selvaraj - arxiv preprint arxiv:2310.05857, 2023 - arxiv.org
Recent work has shown the promise of learning with human feedback paradigms to produce
human-determined high-quality text. Existing works use human feedback to train large …

Depression detection in clinical interviews with LLM-empowered structural element graph

Z Chen, J Deng, J Zhou, J Wu, T Qian… - Proceedings of the …, 2024 - aclanthology.org
Depression is a widespread mental health disorder affecting millions globally. Clinical
interviews are the gold standard for assessing depression, but they heavily rely on scarce …

NoteChat: a dataset of synthetic doctor-patient conversations conditioned on clinical notes

J Wang, Z Yao, Z Yang, H Zhou, R Li, X Wang… - arxiv preprint arxiv …, 2023 - arxiv.org
The detailed clinical records drafted by doctors after each patient's visit are crucial for
medical practitioners and researchers. Automating the creation of these notes with language …

Exploring the opportunities of large language models for summarizing palliative care consultations: A pilot comparative study

X Chen, W Zhou, R Hoda, A Li, C Bain… - Digital Health, 2024 - journals.sagepub.com
Introduction Recent developments in the field of large language models have showcased
impressive achievements in their ability to perform natural language processing tasks …

Do physicians know how to prompt? The need for automatic prompt optimization help in clinical note generation

Z Yao, A Jaafar, B Wang, Z Yang, H Yu - arxiv preprint arxiv:2311.09684, 2023 - arxiv.org
This study examines the effect of prompt engineering on the performance of Large
Language Models (LLMs) in clinical note generation. We introduce an Automatic Prompt …