Evolution of semantic similarity—a survey

D Chandrasekaran, V Mago - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Estimating the semantic similarity between text data is one of the challenging and open
research problems in the field of Natural Language Processing (NLP). The versatility of …

Transfer learning in biomedical natural language processing: an evaluation of BERT and ELMo on ten benchmarking datasets

Y Peng, S Yan, Z Lu - arxiv preprint arxiv:1906.05474, 2019 - arxiv.org
Inspired by the success of the General Language Understanding Evaluation benchmark, we
introduce the Biomedical Language Understanding Evaluation (BLUE) benchmark to …

MedCPT: Contrastive Pre-trained Transformers with large-scale PubMed search logs for zero-shot biomedical information retrieval

Q **, W Kim, Q Chen, DC Comeau, L Yeganova… - …, 2023 - academic.oup.com
Motivation Information retrieval (IR) is essential in biomedical knowledge acquisition and
clinical decision support. While recent progress has shown that language model encoders …

Neural natural language processing for unstructured data in electronic health records: a review

I Li, J Pan, J Goldwasser, N Verma, WP Wong… - Computer Science …, 2022 - Elsevier
Electronic health records (EHRs), digital collections of patient healthcare events and
observations, are ubiquitous in medicine and critical to healthcare delivery, operations, and …

Are large language models ready for healthcare? a comparative study on clinical language understanding

Y Wang, Y Zhao, L Petzold - Machine Learning for …, 2023 - proceedings.mlr.press
Large language models (LLMs) have made significant progress in various domains,
including healthcare. However, the specialized nature of clinical language understanding …

[HTML][HTML] AMMU: a survey of transformer-based biomedical pretrained language models

KS Kalyan, A Rajasekharan, S Sangeetha - Journal of biomedical …, 2022 - Elsevier
Transformer-based pretrained language models (PLMs) have started a new era in modern
natural language processing (NLP). These models combine the power of transformers …

BioELECTRA: pretrained biomedical text encoder using discriminators

KR Kanakarajan, B Kundumani… - Proceedings of the …, 2021 - aclanthology.org
Recent advancements in pretraining strategies in NLP have shown a significant
improvement in the performance of models on various text mining tasks. We apply 'replaced …