Graph neural networks

G Corso, H Stark, S Jegelka, T Jaakkola… - Nature Reviews …, 2024 - nature.com
Graphs are flexible mathematical objects that can represent many entities and knowledge
from different domains, including in the life sciences. Graph neural networks (GNNs) are …

Everything is connected: Graph neural networks

P Veličković - Current Opinion in Structural Biology, 2023 - Elsevier
In many ways, graphs are the main modality of data we receive from nature. This is due to
the fact that most of the patterns we see, both in natural and artificial systems, are elegantly …

Graph neural networks for materials science and chemistry

P Reiser, M Neubert, A Eberhard, L Torresi… - Communications …, 2022 - nature.com
Abstract Machine learning plays an increasingly important role in many areas of chemistry
and materials science, being used to predict materials properties, accelerate simulations …

A survey on oversmoothing in graph neural networks

TK Rusch, MM Bronstein, S Mishra - arxiv preprint arxiv:2303.10993, 2023 - arxiv.org
Node features of graph neural networks (GNNs) tend to become more similar with the
increase of the network depth. This effect is known as over-smoothing, which we …

Recipe for a general, powerful, scalable graph transformer

L Rampášek, M Galkin, VP Dwivedi… - Advances in …, 2022 - proceedings.neurips.cc
We propose a recipe on how to build a general, powerful, scalable (GPS) graph Transformer
with linear complexity and state-of-the-art results on a diverse set of benchmarks. Graph …

[PDF][PDF] Nodeformer: A scalable graph structure learning transformer for node classification

Q Wu, W Zhao, Z Li, D Wipf… - Advances in Neural …, 2022 - proceedings.neurips.cc
Graph neural networks have been extensively studied for learning with interconnected data.
Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing …

On over-squashing in message passing neural networks: The impact of width, depth, and topology

F Di Giovanni, L Giusti, F Barbero… - International …, 2023 - proceedings.mlr.press
Abstract Message Passing Neural Networks (MPNNs) are instances of Graph Neural
Networks that leverage the graph to send messages over the edges. This inductive bias …

Attending to graph transformers

L Müller, M Galkin, C Morris, L Rampášek - arxiv preprint arxiv …, 2023 - arxiv.org
Recently, transformer architectures for graphs emerged as an alternative to established
techniques for machine learning with graphs, such as (message-passing) graph neural …

A comprehensive survey on deep graph representation learning

W Ju, Z Fang, Y Gu, Z Liu, Q Long, Z Qiao, Y Qin… - Neural Networks, 2024 - Elsevier
Graph representation learning aims to effectively encode high-dimensional sparse graph-
structured data into low-dimensional dense vectors, which is a fundamental task that has …

Graph inductive biases in transformers without message passing

L Ma, C Lin, D Lim, A Romero-Soriano… - International …, 2023 - proceedings.mlr.press
Transformers for graph data are increasingly widely studied and successful in numerous
learning tasks. Graph inductive biases are crucial for Graph Transformers, and previous …