Physics-informed machine learning: case studies for weather and climate modelling

K Kashinath, M Mustafa, A Albert… - … of the Royal …, 2021 - royalsocietypublishing.org
Machine learning (ML) provides novel and powerful ways of accurately and efficiently
recognizing complex patterns, emulating nonlinear dynamics, and predicting the spatio …

A survey of graph neural networks in various learning paradigms: methods, applications, and challenges

L Waikhom, R Patgiri - Artificial Intelligence Review, 2023 - Springer
In the last decade, deep learning has reinvigorated the machine learning field. It has solved
many problems in computer vision, speech recognition, natural language processing, and …

How powerful are spectral graph neural networks

X Wang, M Zhang - International conference on machine …, 2022 - proceedings.mlr.press
Abstract Spectral Graph Neural Network is a kind of Graph Neural Network (GNN) based on
graph signal filters. Some models able to learn arbitrary spectral filters have emerged …

Graph neural networks: foundation, frontiers and applications

L Wu, P Cui, J Pei, L Zhao, X Guo - … of the 28th ACM SIGKDD conference …, 2022 - dl.acm.org
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …

Pure transformers are powerful graph learners

J Kim, D Nguyen, S Min, S Cho… - Advances in Neural …, 2022 - proceedings.neurips.cc
We show that standard Transformers without graph-specific modifications can lead to
promising results in graph learning both in theory and practice. Given a graph, we simply …

Representational strengths and limitations of transformers

C Sanford, DJ Hsu, M Telgarsky - Advances in Neural …, 2023 - proceedings.neurips.cc
Attention layers, as commonly used in transformers, form the backbone of modern deep
learning, yet there is no mathematical description of their benefits and deficiencies as …

Gemnet: Universal directional graph neural networks for molecules

J Gasteiger, F Becker… - Advances in Neural …, 2021 - proceedings.neurips.cc
Effectively predicting molecular interactions has the potential to accelerate molecular
dynamics by multiple orders of magnitude and thus revolutionize chemical simulations …

Understanding and extending subgraph gnns by rethinking their symmetries

F Frasca, B Bevilacqua… - Advances in Neural …, 2022 - proceedings.neurips.cc
Subgraph GNNs are a recent class of expressive Graph Neural Networks (GNNs) which
model graphs as collections of subgraphs. So far, the design space of possible Subgraph …

Benchmarking graph neural networks

VP Dwivedi, CK Joshi, AT Luu, T Laurent… - Journal of Machine …, 2023 - jmlr.org
In the last few years, graph neural networks (GNNs) have become the standard toolkit for
analyzing and learning from data on graphs. This emerging field has witnessed an extensive …

Rethinking the expressive power of gnns via graph biconnectivity

B Zhang, S Luo, L Wang, D He - arxiv preprint arxiv:2301.09505, 2023 - arxiv.org
Designing expressive Graph Neural Networks (GNNs) is a central topic in learning graph-
structured data. While numerous approaches have been proposed to improve GNNs in …