Promising directions of machine learning for partial differential equations

SL Brunton, JN Kutz - Nature Computational Science, 2024 - nature.com
Partial differential equations (PDEs) are among the most universal and parsimonious
descriptions of natural physical laws, capturing a rich variety of phenomenology and …

Modern Koopman theory for dynamical systems

SL Brunton, M Budišić, E Kaiser, JN Kutz - arxiv preprint arxiv:2102.12086, 2021 - arxiv.org
The field of dynamical systems is being transformed by the mathematical tools and
algorithms emerging from modern computing and data science. First-principles derivations …

Learning skillful medium-range global weather forecasting

R Lam, A Sanchez-Gonzalez, M Willson, P Wirnsberger… - Science, 2023 - science.org
Global medium-range weather forecasting is critical to decision-making across many social
and economic domains. Traditional numerical weather prediction uses increased compute …

Nodeformer: A scalable graph structure learning transformer for node classification

Q Wu, W Zhao, Z Li, DP Wipf… - Advances in Neural …, 2022 - proceedings.neurips.cc
Graph neural networks have been extensively studied for learning with inter-connected data.
Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing …

Fourier neural operator with learned deformations for pdes on general geometries

Z Li, DZ Huang, B Liu, A Anandkumar - Journal of Machine Learning …, 2023 - jmlr.org
Deep learning surrogate models have shown promise in solving partial differential
equations (PDEs). Among them, the Fourier neural operator (FNO) achieves good accuracy …

Toward causal representation learning

B Schölkopf, F Locatello, S Bauer, NR Ke… - Proceedings of the …, 2021 - ieeexplore.ieee.org
The two fields of machine learning and graphical causality arose and are developed
separately. However, there is, now, cross-pollination and increasing interest in both fields to …

Machine learning–accelerated computational fluid dynamics

D Kochkov, JA Smith, A Alieva… - Proceedings of the …, 2021 - National Acad Sciences
Numerical simulation of fluids plays an essential role in modeling many physical
phenomena, such as weather, climate, aerodynamics, and plasma physics. Fluids are well …

A generalization of transformer networks to graphs

VP Dwivedi, X Bresson - arxiv preprint arxiv:2012.09699, 2020 - arxiv.org
We propose a generalization of transformer neural network architecture for arbitrary graphs.
The original transformer was designed for Natural Language Processing (NLP), which …

Learning mesh-based simulation with graph networks

T Pfaff, M Fortunato, A Sanchez-Gonzalez… - arxiv preprint arxiv …, 2020 - arxiv.org
Mesh-based simulations are central to modeling complex physical systems in many
disciplines across science and engineering. Mesh representations support powerful …

Geometry-informed neural operator for large-scale 3d pdes

Z Li, N Kovachki, C Choy, B Li… - Advances in …, 2024 - proceedings.neurips.cc
We propose the geometry-informed neural operator (GINO), a highly efficient approach to
learning the solution operator of large-scale partial differential equations with varying …