A survey of knowledge enhanced pre-trained language models

L Hu, Z Liu, Z Zhao, L Hou, L Nie… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Pre-trained Language Models (PLMs) which are trained on large text corpus via self-
supervised learning method, have yielded promising performance on various tasks in …

Chatgpt is not enough: Enhancing large language models with knowledge graphs for fact-aware language modeling

L Yang, H Chen, Z Li, X Ding, X Wu - arxiv preprint arxiv:2306.11489, 2023 - arxiv.org
Recently, ChatGPT, a representative large language model (LLM), has gained considerable
attention due to its powerful emergent abilities. Some researchers suggest that LLMs could …

Unifying large language models and knowledge graphs: A roadmap

S Pan, L Luo, Y Wang, C Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the
field of natural language processing and artificial intelligence, due to their emergent ability …

Can knowledge graphs reduce hallucinations in llms?: A survey

G Agrawal, T Kumarage, Z Alghamdi, H Liu - arxiv preprint arxiv …, 2023 - arxiv.org
The contemporary LLMs are prone to producing hallucinations, stemming mainly from the
knowledge gaps within the models. To address this critical limitation, researchers employ …

Give us the facts: Enhancing large language models with knowledge graphs for fact-aware language modeling

L Yang, H Chen, Z Li, X Ding… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Recently, ChatGPT, a representative large language model (LLM), has gained considerable
attention. Due to their powerful emergent abilities, recent LLMs are considered as a possible …

A survey of knowledge-intensive nlp with pre-trained language models

D Yin, L Dong, H Cheng, X Liu, KW Chang… - arxiv preprint arxiv …, 2022 - arxiv.org
With the increasing of model capacity brought by pre-trained language models, there
emerges boosting needs for more knowledgeable natural language processing (NLP) …

Combining knowledge graphs and large language models

A Kau, X He, A Nambissan, A Astudillo, H Yin… - arxiv preprint arxiv …, 2024 - arxiv.org
In recent years, Natural Language Processing (NLP) has played a significant role in various
Artificial Intelligence (AI) applications such as chatbots, text generation, and language …

Knowledge-augmented methods for natural language processing

C Zhu, Y Xu, X Ren, BY Lin, M Jiang, W Yu - Proceedings of the sixteenth …, 2023 - dl.acm.org
Knowledge in NLP has been a rising trend especially after the advent of large-scale pre-
trained models. Knowledge is critical to equip statistics-based models with common sense …

The life cycle of knowledge in big language models: A survey

B Cao, H Lin, X Han, L Sun - Machine Intelligence Research, 2024 - Springer
Abstract Knowledge plays a critical role in artificial intelligence. Recently, the extensive
success of pre-trained language models (PLMs) has raised significant attention about how …

ConKI: Contrastive knowledge injection for multimodal sentiment analysis

Y Yu, M Zhao, S Qi, F Sun, B Wang, W Guo… - arxiv preprint arxiv …, 2023 - arxiv.org
Multimodal Sentiment Analysis leverages multimodal signals to detect the sentiment of a
speaker. Previous approaches concentrate on performing multimodal fusion and …