Transformers and large language models in healthcare: A review

S Nerella, S Bandyopadhyay, J Zhang… - Artificial intelligence in …, 2024 - Elsevier
Abstract With Artificial Intelligence (AI) increasingly permeating various aspects of society,
including healthcare, the adoption of the Transformers neural network architecture is rapidly …

Transformers in healthcare: A survey

S Nerella, S Bandyopadhyay, J Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including
healthcare, the adoption of the Transformers neural network architecture is rapidly changing …

Adaptive co-attention network for named entity recognition in tweets

Q Zhang, J Fu, X Liu, X Huang - Proceedings of the AAAI conference on …, 2018 - ojs.aaai.org
In this study, we investigate the problem of named entity recognition for tweets. Named entity
recognition is an important task in natural language processing and has been carefully …

Cross-type biomedical named entity recognition with deep multi-task learning

X Wang, Y Zhang, X Ren, Y Zhang, M Zitnik… - …, 2019 - academic.oup.com
Motivation State-of-the-art biomedical named entity recognition (BioNER) systems often
require handcrafted features specific to each entity type, such as genes, chemicals and …

Semi-supervised multitask learning for sequence labeling

M Rei - arxiv preprint arxiv:1704.07156, 2017 - arxiv.org
We propose a sequence labeling framework with a secondary training objective, learning to
predict surrounding words for every word in the dataset. This language modeling objective …

Attending to characters in neural sequence labeling models

M Rei, GKO Crichton, S Pyysalo - arxiv preprint arxiv:1611.04361, 2016 - arxiv.org
Sequence labeling architectures use word embeddings for capturing similarity, but suffer
when handling previously unseen or rare words. We investigate character-level extensions …

[HTML][HTML] Character-level neural network for biomedical named entity recognition

M Gridach - Journal of biomedical informatics, 2017 - Elsevier
Biomedical named entity recognition (BNER), which extracts important named entities such
as genes and proteins, is a challenging task in automated systems that mine knowledge in …

[HTML][HTML] Unsupervised biomedical named entity recognition: Experiments with clinical and biological texts

S Zhang, N Elhadad - Journal of biomedical informatics, 2013 - Elsevier
Named entity recognition is a crucial component of biomedical natural language processing,
enabling information extraction and ultimately reasoning over and knowledge discovery …

[PDF][PDF] Introduction to the bio-entity recognition task at JNLPBA

N Collier, T Ohta, Y Tsuruoka, Y Tateisi… - Proceedings of the …, 2004 - aclanthology.org
We describe here the JNLPBA shared task of bio-entity recognition using an extended
version of the GENIA version 3 named entity corpus of MEDLINE abstracts. We provide …

[HTML][HTML] Biomedical text mining and its applications in cancer research

F Zhu, P Patumcharoenpol, C Zhang, Y Yang… - Journal of biomedical …, 2013 - Elsevier
Cancer is a malignant disease that has caused millions of human deaths. Its study has a
long history of well over 100years. There have been an enormous number of publications on …