Large language models on graphs: A comprehensive survey

B **, G Liu, C Han, M Jiang, H Ji… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as GPT4 and LLaMA, are creating significant
advancements in natural language processing, due to their strong text encoding/decoding …

Exploring the potential of large language models (llms) in learning on graphs

Z Chen, H Mao, H Li, W **, H Wen, X Wei… - ACM SIGKDD …, 2024 - dl.acm.org
Learning on Graphs has attracted immense attention due to its wide real-world applications.
The most popular pipeline for learning on graphs with textual node attributes primarily relies …

A survey of graph meets large language model: Progress and future directions

Y Li, Z Li, P Wang, J Li, X Sun, H Cheng… - arxiv preprint arxiv …, 2023 - arxiv.org
Graph plays a significant role in representing and analyzing complex relationships in real-
world applications such as citation networks, social networks, and biological data. Recently …

[PDF][PDF] Natural language is all a graph needs

R Ye, C Zhang, R Wang, S Xu, Y Zhang - arxiv preprint arxiv …, 2023 - yongfeng.me
The emergence of large-scale pre-trained language models, such as ChatGPT, has
revolutionized various research fields in artificial intelligence. Transformersbased large …

Graphmae2: A decoding-enhanced masked self-supervised graph learner

Z Hou, Y He, Y Cen, X Liu, Y Dong… - Proceedings of the …, 2023 - dl.acm.org
Graph self-supervised learning (SSL), including contrastive and generative approaches,
offers great potential to address the fundamental challenge of label scarcity in real-world …

Towards graph foundation models: A survey and beyond

J Liu, C Yang, Z Lu, J Chen, Y Li, M Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Emerging as fundamental building blocks for diverse artificial intelligence applications,
foundation models have achieved notable success across natural language processing and …

A comprehensive study on large-scale graph training: Benchmarking and rethinking

K Duan, Z Liu, P Wang, W Zheng… - Advances in …, 2022 - proceedings.neurips.cc
Large-scale graph training is a notoriously challenging problem for graph neural networks
(GNNs). Due to the nature of evolving graph structures into the training process, vanilla …

Simteg: A frustratingly simple approach improves textual graph learning

K Duan, Q Liu, TS Chua, S Yan, WT Ooi, Q **e… - arxiv preprint arxiv …, 2023 - arxiv.org
Textual graphs (TGs) are graphs whose nodes correspond to text (sentences or documents),
which are widely prevalent. The representation learning of TGs involves two stages:(i) …

Harnessing explanations: Llm-to-lm interpreter for enhanced text-attributed graph representation learning

X He, X Bresson, T Laurent, A Perold, Y LeCun… - arxiv preprint arxiv …, 2023 - arxiv.org
Representation learning on text-attributed graphs (TAGs) has become a critical research
problem in recent years. A typical example of a TAG is a paper citation graph, where the text …

Graphtext: Graph reasoning in text space

J Zhao, L Zhuo, Y Shen, M Qu, K Liu… - arxiv preprint arxiv …, 2023 - arxiv.org
Large Language Models (LLMs) have gained the ability to assimilate human knowledge and
facilitate natural language interactions with both humans and other LLMs. However, despite …