Towards understanding generalization of graph neural networks

H Tang, Y Liu - International Conference on Machine …, 2023 - proceedings.mlr.press
Graph neural networks (GNNs) are widely used in machine learning for graph-structured
data. Even though GNNs have achieved remarkable success in real-world applications …

Wl meet vc

C Morris, F Geerts, J Tönshoff… - … Conference on Machine …, 2023 - proceedings.mlr.press
Recently, many works studied the expressive power of graph neural networks (GNNs) by
linking it to the $1 $-dimensional Weisfeiler-Leman algorithm ($1\text {-}\mathsf {WL} $) …

Multi-sensor fusion fault diagnosis method of wind turbine bearing based on adaptive convergent viewable neural networks

X Li, Y Wang, J Yao, M Li, Z Gao - Reliability Engineering & System Safety, 2024 - Elsevier
Effective condition monitoring and fault diagnosis of rolling bearings, integral components of
rotating machinery, are crucial for ensuring equipment reliability. However, existing …

Graph neural networks for road safety modeling: datasets and evaluations for accident analysis

A Nippani, D Li, H Ju… - Advances in Neural …, 2024 - proceedings.neurips.cc
We consider the problem of traffic accident analysis on a road network based on road
network connections and traffic volume. Previous works have designed various deep …

GFT: Graph Foundation Model with Transferable Tree Vocabulary

Z Wang, Z Zhang, NV Chawla, C Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Inspired by the success of foundation models in applications such as ChatGPT, as graph
data has been ubiquitous, one can envision the far-reaching impacts that can be brought by …

Weisfeiler-Leman at the margin: When more expressivity matters

BJ Franks, C Morris, A Velingker, F Geerts - arxiv preprint arxiv …, 2024 - arxiv.org
The Weisfeiler-Leman algorithm ($1 $-WL) is a well-studied heuristic for the graph
isomorphism problem. Recently, the algorithm has played a prominent role in understanding …

Identification of negative transfers in multitask learning using surrogate models

D Li, HL Nguyen, HR Zhang - arxiv preprint arxiv:2303.14582, 2023 - arxiv.org
Multitask learning is widely used in practice to train a low-resource target task by
augmenting it with multiple related source tasks. Yet, naively combining all the source tasks …

Analyzing deep pac-bayesian learning with neural tangent kernel: Convergence, analytic generalization bound, and efficient hyperparameter selection

W Huang, C Liu, Y Chen, RY Da Xu… - … on Machine Learning …, 2023 - openreview.net
PAC-Bayes is a well-established framework for analyzing generalization performance in
machine learning models. This framework provides a bound on the expected population …

Scalable Multitask Learning Using Gradient-based Estimation of Task Affinity

D Li, A Sharma, HR Zhang - Proceedings of the 30th ACM SIGKDD …, 2024 - dl.acm.org
Multitask learning is a widely used paradigm for training models on diverse tasks, with
applications ranging from graph neural networks to language model fine-tuning. Since tasks …

Generalization Error of Graph Neural Networks in the Mean-field Regime

G Aminian, Y He, G Reinert, Ł Szpruch… - arxiv preprint arxiv …, 2024 - arxiv.org
This work provides a theoretical framework for assessing the generalization error of graph
classification tasks via graph neural networks in the over-parameterized regime, where the …