Large Language Models (LLMs) on Tabular Data: Prediction, Generation, and Understanding--A Survey

X Fang, W Xu, FA Tan, J Zhang, Z Hu, Y Qi… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent breakthroughs in large language modeling have facilitated rigorous exploration of
their application in diverse tasks related to tabular data modeling, such as prediction, tabular …

The heterophilic graph learning handbook: Benchmarks, models, theoretical analysis, applications and challenges

S Luan, C Hua, Q Lu, L Ma, L Wu, X Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Homophily principle,\ie {} nodes with the same labels or similar attributes are more likely to
be connected, has been commonly believed to be the main reason for the superiority of …

Talk like a graph: Encoding graphs for large language models

B Fatemi, J Halcrow, B Perozzi - arxiv preprint arxiv:2310.04560, 2023 - arxiv.org
Graphs are a powerful tool for representing and analyzing complex relationships in real-
world applications such as social networks, recommender systems, and computational …

Language is all a graph needs

R Ye, C Zhang, R Wang, S Xu, Y Zhang - arxiv preprint arxiv:2308.07134, 2023 - arxiv.org
The emergence of large-scale pre-trained language models has revolutionized various AI
research domains. Transformers-based Large Language Models (LLMs) have gradually …

Graph mamba: Towards learning on graphs with state space models

A Behrouz, F Hashemi - Proceedings of the 30th ACM SIGKDD …, 2024 - dl.acm.org
Graph Neural Networks (GNNs) have shown promising potential in graph representation
learning. The majority of GNNs define a local message-passing mechanism, propagating …

Towards graph foundation models: A survey and beyond

J Liu, C Yang, Z Lu, J Chen, Y Li, M Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Foundation models have emerged as critical components in a variety of artificial intelligence
applications, and showcase significant success in natural language processing and several …

Trustworthy graph neural networks: Aspects, methods, and trends

H Zhang, B Wu, X Yuan, S Pan, H Tong… - Proceedings of the …, 2024 - ieeexplore.ieee.org
Graph neural networks (GNNs) have emerged as a series of competent graph learning
methods for diverse real-world scenarios, ranging from daily applications such as …

Weisfeiler and leman go machine learning: The story so far

C Morris, Y Lipman, H Maron, B Rieck… - Journal of Machine …, 2023 - jmlr.org
In recent years, algorithms and neural architectures based on the Weisfeiler-Leman
algorithm, a well-known heuristic for the graph isomorphism problem, have emerged as a …

On the connection between mpnn and graph transformer

C Cai, TS Hy, R Yu, Y Wang - International conference on …, 2023 - proceedings.mlr.press
Graph Transformer (GT) recently has emerged as a new paradigm of graph learning
algorithms, outperforming the previously popular Message Passing Neural Network (MPNN) …

Position: Graph foundation models are already here

H Mao, Z Chen, W Tang, J Zhao, Y Ma… - … on Machine Learning, 2024 - openreview.net
Graph Foundation Models (GFMs) are emerging as a significant research topic in the graph
domain, aiming to develop graph models trained on extensive and diverse data to enhance …