The shaky foundations of large language models and foundation models for electronic health records

M Wornow, Y Xu, R Thapa, B Patel, E Steinberg… - npj digital …, 2023 - nature.com
The success of foundation models such as ChatGPT and AlphaFold has spurred significant
interest in building similar models for electronic medical records (EMRs) to improve patient …

Ethical machine learning in healthcare

IY Chen, E Pierson, S Rose, S Joshi… - Annual review of …, 2021 - annualreviews.org
The use of machine learning (ML) in healthcare raises numerous ethical concerns,
especially as models can amplify existing health inequities. Here, we outline ethical …

Ehrshot: An ehr benchmark for few-shot evaluation of foundation models

M Wornow, R Thapa, E Steinberg… - Advances in Neural …, 2023 - proceedings.neurips.cc
While the general machine learning (ML) community has benefited from public datasets,
tasks, and models, the progress of ML in healthcare has been hampered by a lack of such …

Event Stream GPT: a data pre-processing and modeling library for generative, pre-trained transformers over continuous-time sequences of complex events

M McDermott, B Nestor, P Argaw… - Advances in Neural …, 2023 - proceedings.neurips.cc
Generative, pre-trained transformers (GPTs, a type of" Foundation Models") have reshaped
natural language processing (NLP) through their versatility in diverse downstream tasks …

Use of deep learning to develop continuous-risk models for adverse event prediction from electronic health records

N Tomašev, N Harris, S Baur, A Mottram, X Glorot… - Nature …, 2021 - nature.com
Early prediction of patient outcomes is important for targeting preventive care. This protocol
describes a practical workflow for develo** deep-learning risk models that can predict …

Efficient and effective multi-task grou** via meta learning on task combinations

X Song, S Zheng, W Cao, J Yu… - Advances in Neural …, 2022 - proceedings.neurips.cc
As a longstanding learning paradigm, multi-task learning has been widely applied into a
variety of machine learning applications. Nonetheless, identifying which tasks should be …

Improving medical predictions by irregular multimodal electronic health records modeling

X Zhang, S Li, Z Chen, X Yan… - … on Machine Learning, 2023 - proceedings.mlr.press
Health conditions among patients in intensive care units (ICUs) are monitored via electronic
health records (EHRs), composed of numerical time series and lengthy clinical note …

CEHR-BERT: Incorporating temporal information from structured EHR data to improve prediction tasks

C Pang, X Jiang, KS Kalluri, M Spotnitz… - … Learning for Health, 2021 - proceedings.mlr.press
Embedding algorithms are increasingly used to represent clinical concepts in healthcare for
improving machine learning tasks such as clinical phenoty** and disease prediction …

Transfer learning with deep tabular models

R Levin, V Cherepanova, A Schwarzschild… - arxiv preprint arxiv …, 2022 - arxiv.org
Recent work on deep learning for tabular data demonstrates the strong performance of deep
tabular models, often bridging the gap between gradient boosted decision trees and neural …

Warpformer: A multi-scale modeling approach for irregular clinical time series

J Zhang, S Zheng, W Cao, J Bian, J Li - Proceedings of the 29th ACM …, 2023 - dl.acm.org
Irregularly sampled multivariate time series are ubiquitous in various fields, particularly in
healthcare, and exhibit two key characteristics: intra-series irregularity and inter-series …