Physics-informed machine learning
Despite great progress in simulating multiphysics problems using the numerical
discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate …
discretization of partial differential equations (PDEs), one still cannot seamlessly incorporate …
A survey on neural network interpretability
Along with the great success of deep neural networks, there is also growing concern about
their black-box nature. The interpretability issue affects people's trust on deep learning …
their black-box nature. The interpretability issue affects people's trust on deep learning …
Invariant risk minimization
We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant
correlations across multiple training distributions. To achieve this goal, IRM learns a data …
correlations across multiple training distributions. To achieve this goal, IRM learns a data …
Deep learning for generic object detection: A survey
Object detection, one of the most fundamental and challenging problems in computer vision,
seeks to locate object instances from a large number of predefined categories in natural …
seeks to locate object instances from a large number of predefined categories in natural …
Deformable convolutional networks
Convolutional neural networks (CNNs) are inherently limited to model geometric
transformations due to the fixed geometric structures in its building modules. In this work, we …
transformations due to the fixed geometric structures in its building modules. In this work, we …
Geometric deep learning: going beyond euclidean data
Geometric deep learning is an umbrella term for emerging techniques attempting to
generalize (structured) deep neural models to non-Euclidean domains, such as graphs and …
generalize (structured) deep neural models to non-Euclidean domains, such as graphs and …
Spatial transformer networks
Abstract Convolutional Neural Networks define an exceptionallypowerful class of model, but
are still limited by the lack of abilityto be spatially invariant to the input data in a …
are still limited by the lack of abilityto be spatially invariant to the input data in a …
Group equivariant convolutional networks
Abstract We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a
natural generalization of convolutional neural networks that reduces sample complexity by …
natural generalization of convolutional neural networks that reduces sample complexity by …
Prevalence of neural collapse during the terminal phase of deep learning training
Modern practice for training classification deepnets involves a terminal phase of training
(TPT), which begins at the epoch where training error first vanishes. During TPT, the training …
(TPT), which begins at the epoch where training error first vanishes. During TPT, the training …
Making convolutional networks shift-invariant again
R Zhang - International conference on machine learning, 2019 - proceedings.mlr.press
Modern convolutional networks are not shift-invariant, as small input shifts or translations
can cause drastic changes in the output. Commonly used downsampling methods, such as …
can cause drastic changes in the output. Commonly used downsampling methods, such as …