Large language models on graphs: A comprehensive survey

B **, G Liu, C Han, M Jiang, H Ji… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as GPT4 and LLaMA, are creating significant
advancements in natural language processing, due to their strong text encoding/decoding …

A survey of graph meets large language model: Progress and future directions

Y Li, Z Li, P Wang, J Li, X Sun, H Cheng… - arxiv preprint arxiv …, 2023 - arxiv.org
Graph plays a significant role in representing and analyzing complex relationships in real-
world applications such as citation networks, social networks, and biological data. Recently …

Exploring the potential of large language models (llms) in learning on graphs

Z Chen, H Mao, H Li, W **, H Wen, X Wei… - ACM SIGKDD …, 2024 - dl.acm.org
Learning on Graphs has attracted immense attention due to its wide real-world applications.
The most popular pipeline for learning on graphs with textual node attributes primarily relies …

Language is all a graph needs

R Ye, C Zhang, R Wang, S Xu, Y Zhang - arxiv preprint arxiv:2308.07134, 2023 - arxiv.org
The emergence of large-scale pre-trained language models has revolutionized various AI
research domains. Transformers-based Large Language Models (LLMs) have gradually …

Towards graph foundation models: A survey and beyond

J Liu, C Yang, Z Lu, J Chen, Y Li, M Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Foundation models have emerged as critical components in a variety of artificial intelligence
applications, and showcase significant success in natural language processing and several …

Harnessing explanations: Llm-to-lm interpreter for enhanced text-attributed graph representation learning

X He, X Bresson, T Laurent, A Perold, Y LeCun… - arxiv preprint arxiv …, 2023 - arxiv.org
Representation learning on text-attributed graphs (TAGs) has become a critical research
problem in recent years. A typical example of a TAG is a paper citation graph, where the text …

Graphtext: Graph reasoning in text space

J Zhao, L Zhuo, Y Shen, M Qu, K Liu… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have gained the ability to assimilate human knowledge and
facilitate natural language interactions with both humans and other LLMs. However, despite …

A survey of large language models for graphs

X Ren, J Tang, D Yin, N Chawla, C Huang - Proceedings of the 30th …, 2024 - dl.acm.org
Graphs are an essential data structure utilized to represent relationships in real-world
scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver …

Simteg: A frustratingly simple approach improves textual graph learning

K Duan, Q Liu, TS Chua, S Yan, WT Ooi, Q **e… - arxiv preprint arxiv …, 2023 - arxiv.org
Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents),
which are widely prevalent. The representation learning of TGs involves two stages:(i) …

Augmenting low-resource text classification with graph-grounded pre-training and prompting

Z Wen, Y Fang - Proceedings of the 46th International ACM SIGIR …, 2023 - dl.acm.org
Text classification is a fundamental problem in information retrieval with many real-world
applications, such as predicting the topics of online articles and the categories of e …