Pre-trained models for natural language processing: A survey

X Qiu, T Sun, Y Xu, Y Shao, N Dai, X Huang - Science China …, 2020 - Springer
Recently, the emergence of pre-trained models (PTMs) has brought natural language
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …

[HTML][HTML] A survey of multimodal information fusion for smart healthcare: Map** the journey from data to wisdom

T Shaik, X Tao, L Li, H **e, JD Velásquez - Information Fusion, 2024 - Elsevier
Multimodal medical data fusion has emerged as a transformative approach in smart
healthcare, enabling a comprehensive understanding of patient health and personalized …

[HTML][HTML] AMMU: a survey of transformer-based biomedical pretrained language models

KS Kalyan, A Rajasekharan, S Sangeetha - Journal of biomedical …, 2022 - Elsevier
Transformer-based pretrained language models (PLMs) have started a new era in modern
natural language processing (NLP). These models combine the power of transformers …

Pre-training methods in information retrieval

Y Fan, X **e, Y Cai, J Chen, X Ma, X Li… - … and Trends® in …, 2022 - nowpublishers.com
The core of information retrieval (IR) is to identify relevant information from large-scale
resources and return it as a ranked list to respond to user's information need. In recent years …

A comparative study of using pre-trained language models for toxic comment classification

Z Zhao, Z Zhang, F Hopfgartner - Companion Proceedings of the Web …, 2021 - dl.acm.org
As user-generated contents thrive, so does the spread of toxic comment. Therefore,
detecting toxic comment becomes an active research area, and it is often handled as a text …

[HTML][HTML] A review on Natural Language Processing Models for COVID-19 research

K Hall, V Chang, C Jayne - Healthcare Analytics, 2022 - Elsevier
This survey paper reviews Natural Language Processing Models and their use in COVID-19
research in two main areas. Firstly, a range of transformer-based biomedical pretrained …

Short-text semantic similarity (stss): Techniques, challenges and future perspectives

ZH Amur, Y Kwang Hooi, H Bhanbhro, K Dahri… - Applied Sciences, 2023 - mdpi.com
In natural language processing, short-text semantic similarity (STSS) is a very prominent
field. It has a significant impact on a broad range of applications, such as question …

Phraseformer: Multimodal key-phrase extraction using transformer and graph embedding

N Nikzad-Khasmakhi, MR Feizi-Derakhshi… - arxiv preprint arxiv …, 2021 - arxiv.org
Background: Keyword extraction is a popular research topic in the field of natural language
processing. Keywords are terms that describe the most relevant information in a document …

Detecting emerging technologies and their evolution using deep learning and weak signal analysis

A Ebadi, A Auger, Y Gauthier - Journal of Informetrics, 2022 - Elsevier
Emerging technologies can have major economic impacts and affect strategic stability. Yet,
early identification of emerging technologies remains challenging. In order to identify …

Current status and future directions of deep learning applications for safety management in construction

HTTL Pham, M Rafieizonooz, SU Han, DE Lee - Sustainability, 2021 - mdpi.com
The application of deep learning (DL) for solving construction safety issues has achieved
remarkable results in recent years that are superior to traditional methods. However, there is …