[HTML][HTML] Summary of chatgpt-related research and perspective towards the future of large language models

Y Liu, T Han, S Ma, J Zhang, Y Yang, J Tian, H He, A Li… - Meta-Radiology, 2023 - Elsevier
This paper presents a comprehensive survey of ChatGPT-related (GPT-3.5 and GPT-4)
research, state-of-the-art large language models (LLM) from the GPT series, and their …

[HTML][HTML] A comparison review of transfer learning and self-supervised learning: Definitions, applications, advantages and limitations

Z Zhao, L Alzubaidi, J Zhang, Y Duan, Y Gu - Expert Systems with …, 2024 - Elsevier
Deep learning has emerged as a powerful tool in various domains, revolutionising machine
learning research. However, one persistent challenge is the scarcity of labelled training …

Large language models for generative information extraction: A survey

D Xu, W Chen, W Peng, C Zhang, T Xu, X Zhao… - Frontiers of Computer …, 2024 - Springer
Abstract Information Extraction (IE) aims to extract structural knowledge from plain natural
language texts. Recently, generative Large Language Models (LLMs) have demonstrated …

Unified structure generation for universal information extraction

Y Lu, Q Liu, D Dai, X **ao, H Lin, X Han, L Sun… - arxiv preprint arxiv …, 2022 - arxiv.org
Information extraction suffers from its varying targets, heterogeneous structures, and
demand-specific schemas. In this paper, we propose a unified text-to-structure generation …

Recent advances in natural language processing via large pre-trained language models: A survey

B Min, H Ross, E Sulem, APB Veyseh… - ACM Computing …, 2023 - dl.acm.org
Large, pre-trained language models (PLMs) such as BERT and GPT have drastically
changed the Natural Language Processing (NLP) field. For numerous NLP tasks …

DEGREE: A data-efficient generation-based event extraction model

I Hsu, KH Huang, E Boschee, S Miller… - arxiv preprint arxiv …, 2021 - arxiv.org
Event extraction requires high-quality expert human annotations, which are usually
expensive. Therefore, learning a data-efficient event extraction model that can be trained …

Prompt for extraction? PAIE: Prompting argument interaction for event argument extraction

Y Ma, Z Wang, Y Cao, M Li, M Chen, K Wang… - arxiv preprint arxiv …, 2022 - arxiv.org
In this paper, we propose an effective yet efficient model PAIE for both sentence-level and
document-level Event Argument Extraction (EAE), which also generalizes well when there is …

Dynamic prefix-tuning for generative template-based event extraction

X Liu, H Huang, G Shi, B Wang - arxiv preprint arxiv:2205.06166, 2022 - arxiv.org
We consider event extraction in a generative manner with template-based conditional
generation. Although there is a rising trend of casting the task of event extraction as a …

Generative knowledge graph construction: A review

H Ye, N Zhang, H Chen, H Chen - arxiv preprint arxiv:2210.12714, 2022 - arxiv.org
Generative Knowledge Graph Construction (KGC) refers to those methods that leverage the
sequence-to-sequence framework for building knowledge graphs, which is flexible and can …

A survey on deep learning event extraction: Approaches and applications

Q Li, J Li, J Sheng, S Cui, J Wu, Y Hei… - … on Neural Networks …, 2022 - ieeexplore.ieee.org
Event extraction (EE) is a crucial research task for promptly apprehending event information
from massive textual data. With the rapid development of deep learning, EE based on deep …