Integrating scientific knowledge with machine learning for engineering and environmental systems

J Willard, X Jia, S Xu, M Steinbach, V Kumar - ACM Computing Surveys, 2022 - dl.acm.org
There is a growing consensus that solutions to complex science and engineering problems
require novel methodologies that are able to integrate traditional physics-based modeling …

A review of deep learning approaches for inverse scattering problems (invited review)

X Chen, Z Wei, L Maokun, P Rocca - Electromagnetic Waves, 2020 - iris.unitn.it
In recent years, deep learning (DL) is becoming an increasingly important tool for solving
inverse scattering problems (ISPs). This paper reviews methods, promises, and pitfalls of …

Neural operator: Learning maps between function spaces with applications to pdes

N Kovachki, Z Li, B Liu, K Azizzadenesheli… - Journal of Machine …, 2023 - jmlr.org
The classical development of neural networks has primarily focused on learning map**s
between finite dimensional Euclidean spaces or finite sets. We propose a generalization of …

Resmlp: Feedforward networks for image classification with data-efficient training

H Touvron, P Bojanowski, M Caron… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
We present ResMLP, an architecture built entirely upon multi-layer perceptrons for image
classification. It is a simple residual network that alternates (i) a linear layer in which image …

Error estimates for deeponets: A deep learning framework in infinite dimensions

S Lanthaler, S Mishra… - … of Mathematics and Its …, 2022 - academic.oup.com
DeepONets have recently been proposed as a framework for learning nonlinear operators
map** between infinite-dimensional Banach spaces. We analyze DeepONets and prove …

[PDF][PDF] Integrating physics-based modeling with machine learning: A survey

J Willard, X Jia, S Xu, M Steinbach… - arxiv preprint arxiv …, 2020 - beiyulincs.github.io
There is a growing consensus that solutions to complex science and engineering problems
require novel methodologies that are able to integrate traditional physics-based modeling …

Frequency principle: Fourier analysis sheds light on deep neural networks

ZQJ Xu, Y Zhang, T Luo, Y **ao, Z Ma - arxiv preprint arxiv:1901.06523, 2019 - arxiv.org
We study the training process of Deep Neural Networks (DNNs) from the Fourier analysis
perspective. We demonstrate a very universal Frequency Principle (F-Principle)--DNNs often …

An overview on deep learning-based approximation methods for partial differential equations

C Beck, M Hutzenthaler, A Jentzen… - arxiv preprint arxiv …, 2020 - arxiv.org
It is one of the most challenging problems in applied mathematics to approximatively solve
high-dimensional partial differential equations (PDEs). Recently, several deep learning …

Algorithms for solving high dimensional PDEs: from nonlinear Monte Carlo to machine learning

E Weinan, J Han, A Jentzen - Nonlinearity, 2021 - iopscience.iop.org
In recent years, tremendous progress has been made on numerical algorithms for solving
partial differential equations (PDEs) in a very high dimension, using ideas from either …

The cost-accuracy trade-off in operator learning with neural networks

MV de Hoop, DZ Huang, E Qian, AM Stuart - arxiv preprint arxiv …, 2022 - arxiv.org
The termsurrogate modeling'in computational science and engineering refers to the
development of computationally efficient approximations for expensive simulations, such as …