Pre-trained models for natural language processing: A survey

X Qiu, T Sun, Y Xu, Y Shao, N Dai, X Huang - Science China …, 2020 - Springer
Recently, the emergence of pre-trained models (PTMs) has brought natural language
processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs …

A large language model for electronic health records

X Yang, A Chen, N PourNejatian, HC Shin… - NPJ digital …, 2022 - nature.com
There is an increasing interest in develo** artificial intelligence (AI) systems to process
and interpret electronic health records (EHRs). Natural language processing (NLP) powered …

Interpreting deep learning models in natural language processing: A review

X Sun, D Yang, X Li, T Zhang, Y Meng, H Qiu… - ar** artificial intelligence (AI) systems to process
and interpret electronic health records (EHRs). Natural language processing (NLP) powered …

Transfernet: An effective and transparent framework for multi-hop question answering over relation graph

J Shi, S Cao, L Hou, J Li, H Zhang - arxiv preprint arxiv:2104.07302, 2021 - arxiv.org
Multi-hop Question Answering (QA) is a challenging task because it requires precise
reasoning with entity relations at every step towards the answer. The relations can be …

Mengzi: Towards lightweight yet ingenious pre-trained models for chinese

Z Zhang, H Zhang, K Chen, Y Guo, J Hua… - arxiv preprint arxiv …, 2021 - arxiv.org
Although pre-trained models (PLMs) have achieved remarkable improvements in a wide
range of NLP tasks, they are expensive in terms of time and resources. This calls for the …

Unifiedqa-v2: Stronger generalization via broader cross-format training

D Khashabi, Y Kordi, H Hajishirzi - arxiv preprint arxiv:2202.12359, 2022 - arxiv.org
arxiv:2202.12359v1 [cs.CL] 23 Feb 2022 Page 1 UNIFIEDQA-v2: Stronger Generalization via
Broader Cross-Format Training Daniel Khashabi1 Yeganeh Kordi2 Hannaneh Hajishirzi1,3 …

Topic-aware multi-turn dialogue modeling

Y Xu, H Zhao, Z Zhang - Proceedings of the AAAI Conference on …, 2021 - ojs.aaai.org
In the retrieval-based multi-turn dialogue modeling, it remains a challenge to select the most
appropriate response according to extracting salient features in context utterances. As a …