A survey of knowledge enhanced pre-trained language models

L Hu, Z Liu, Z Zhao, L Hou, L Nie… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Pre-trained Language Models (PLMs) which are trained on large text corpus via self-
supervised learning method, have yielded promising performance on various tasks in …

Unifying large language models and knowledge graphs: A roadmap

S Pan, L Luo, Y Wang, C Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the
field of natural language processing and artificial intelligence, due to their emergent ability …

Symbolic knowledge distillation: from general language models to commonsense models

P West, C Bhagavatula, J Hessel, JD Hwang… - arxiv preprint arxiv …, 2021 - arxiv.org
The common practice for training commonsense models has gone from-human-to-corpus-to-
machine: humans author commonsense knowledge graphs in order to train commonsense …

Open-world story generation with structured knowledge enhancement: A comprehensive survey

Y Wang, J Lin, Z Yu, W Hu, BF Karlsson - Neurocomputing, 2023 - Elsevier
Storytelling and narrative are fundamental to human experience, intertwined with our social
and cultural engagement. As such, researchers have long attempted to create systems that …

Promptcap: Prompt-guided image captioning for vqa with gpt-3

Y Hu, H Hua, Z Yang, W Shi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Knowledge-based visual question answering (VQA) involves questions that require
world knowledge beyond the image to yield the correct answer. Large language models …

Promptcap: Prompt-guided task-aware image captioning

Y Hu, H Hua, Z Yang, W Shi, NA Smith… - arxiv preprint arxiv …, 2022 - arxiv.org
Knowledge-based visual question answering (VQA) involves questions that require world
knowledge beyond the image to yield the correct answer. Large language models (LMs) like …

DEGREE: A data-efficient generation-based event extraction model

I Hsu, KH Huang, E Boschee, S Miller… - arxiv preprint arxiv …, 2021 - arxiv.org
Event extraction requires high-quality expert human annotations, which are usually
expensive. Therefore, learning a data-efficient event extraction model that can be trained …

Extracting cultural commonsense knowledge at scale

TP Nguyen, S Razniewski, A Varde… - Proceedings of the ACM …, 2023 - dl.acm.org
Structured knowledge is important for many AI applications. Commonsense knowledge,
which is crucial for robust human-centric AI, is covered by a small number of structured …

A survey on deep learning event extraction: Approaches and applications

Q Li, J Li, J Sheng, S Cui, J Wu, Y Hei… - … on Neural Networks …, 2022 - ieeexplore.ieee.org
Event extraction (EE) is a crucial research task for promptly apprehending event information
from massive textual data. With the rapid development of deep learning, EE based on deep …

Social recommendation with self-supervised metagraph informax network

X Long, C Huang, Y Xu, H Xu, P Dai, L **a… - Proceedings of the 30th …, 2021 - dl.acm.org
In recent years, researchers attempt to utilize online social information to alleviate data
sparsity for collaborative filtering, based on the rationale that social networks offers the …