Neural network approximation

R DeVore, B Hanin, G Petrova - Acta Numerica, 2021 - cambridge.org
Neural networks (NNs) are the method of choice for building learning algorithms. They are
now being investigated for other numerical tasks such as solving high-dimensional partial …

Opportunities and challenges of diffusion models for generative AI

M Chen, S Mei, J Fan, M Wang - National Science Review, 2024 - academic.oup.com
Diffusion models, a powerful and universal generative artificial intelligence technology, have
achieved tremendous success and opened up new possibilities in diverse applications. In …

hp-VPINNs: Variational physics-informed neural networks with domain decomposition

E Kharazmi, Z Zhang, GE Karniadakis - Computer Methods in Applied …, 2021 - Elsevier
We formulate a general framework for hp-variational physics-informed neural networks (hp-
VPINNs) based on the nonlinear approximation of shallow and deep neural networks and …

Model reduction and neural networks for parametric PDEs

K Bhattacharya, B Hosseini, NB Kovachki… - The SMAI journal of …, 2021 - numdam.org
We develop a general framework for data-driven approximation of input-output maps
between infinitedimensional spaces. The proposed approach is motivated by the recent …

Universal approximation with deep narrow networks

P Kidger, T Lyons - Conference on learning theory, 2020 - proceedings.mlr.press
Abstract The classical Universal Approximation Theorem holds for neural networks of
arbitrary width and bounded depth. Here we consider the natural 'dual'scenario for networks …

Variational physics-informed neural networks for solving partial differential equations

E Kharazmi, Z Zhang, GE Karniadakis - arxiv preprint arxiv:1912.00873, 2019 - arxiv.org
Physics-informed neural networks (PINNs)[31] use automatic differentiation to solve partial
differential equations (PDEs) by penalizing the PDE in the loss function at a random set of …

A universal approximation theorem of deep neural networks for expressing probability distributions

Y Lu, J Lu - Advances in neural information processing …, 2020 - proceedings.neurips.cc
This paper studies the universal approximation property of deep neural networks for
representing probability distributions. Given a target distribution $\pi $ and a source …

The difficulty of computing stable and accurate neural networks: On the barriers of deep learning and Smale's 18th problem

MJ Colbrook, V Antun, AC Hansen - … of the National Academy of Sciences, 2022 - pnas.org
Deep learning (DL) has had unprecedented success and is now entering scientific
computing with full force. However, current DL methods typically suffer from instability, even …

Theoretical issues in deep networks

T Poggio, A Banburski, Q Liao - Proceedings of the National Academy of …, 2020 - pnas.org
While deep learning is successful in a number of applications, it is not yet well understood
theoretically. A theoretical characterization of deep learning should answer questions about …

The cost-accuracy trade-off in operator learning with neural networks

MV de Hoop, DZ Huang, E Qian, AM Stuart - arxiv preprint arxiv …, 2022 - arxiv.org
The termsurrogate modeling'in computational science and engineering refers to the
development of computationally efficient approximations for expensive simulations, such as …