Physics-informed machine learning

GE Karniadakis, IG Kevrekidis, L Lu… - Nature Reviews …, 2021 - nature.com
Despite great progress in simulating multiphysics problems using the numerical
discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate …

A survey on neural network interpretability

Y Zhang, P Tiňo, A Leonardis… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Along with the great success of deep neural networks, there is also growing concern about
their black-box nature. The interpretability issue affects people's trust on deep learning …

Invariant risk minimization

M Arjovsky, L Bottou, I Gulrajani… - arxiv preprint arxiv …, 2019 - arxiv.org
We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant
correlations across multiple training distributions. To achieve this goal, IRM learns a data …

Deep learning for generic object detection: A survey

L Liu, W Ouyang, X Wang, P Fieguth, J Chen… - International journal of …, 2020 - Springer
Object detection, one of the most fundamental and challenging problems in computer vision,
seeks to locate object instances from a large number of predefined categories in natural …

Deformable convolutional networks

J Dai, H Qi, Y **ong, Y Li, G Zhang… - Proceedings of the …, 2017 - openaccess.thecvf.com
Convolutional neural networks (CNNs) are inherently limited to model geometric
transformations due to the fixed geometric structures in its building modules. In this work, we …

Geometric deep learning: going beyond euclidean data

MM Bronstein, J Bruna, Y LeCun… - IEEE Signal …, 2017 - ieeexplore.ieee.org
Geometric deep learning is an umbrella term for emerging techniques attempting to
generalize (structured) deep neural models to non-Euclidean domains, such as graphs and …

Spatial transformer networks

M Jaderberg, K Simonyan… - Advances in neural …, 2015 - proceedings.neurips.cc
Abstract Convolutional Neural Networks define an exceptionallypowerful class of model, but
are still limited by the lack of abilityto be spatially invariant to the input data in a …

Group equivariant convolutional networks

T Cohen, M Welling - International conference on machine …, 2016 - proceedings.mlr.press
Abstract We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a
natural generalization of convolutional neural networks that reduces sample complexity by …

Prevalence of neural collapse during the terminal phase of deep learning training

V Papyan, XY Han, DL Donoho - Proceedings of the …, 2020 - National Acad Sciences
Modern practice for training classification deepnets involves a terminal phase of training
(TPT), which begins at the epoch where training error first vanishes. During TPT, the training …

Making convolutional networks shift-invariant again

R Zhang - International conference on machine learning, 2019 - proceedings.mlr.press
Modern convolutional networks are not shift-invariant, as small input shifts or translations
can cause drastic changes in the output. Commonly used downsampling methods, such as …