Theory of classification: A survey of some recent advances

S Boucheron, O Bousquet, G Lugosi - ESAIM: probability and …, 2005 - cambridge.org
Theory of Classification: a Survey of Some Recent Advances Page 1 ESAIM: PS ESAIM:
Probability and Statistics November 2005, Vol. 9, p. 323–375 DOI: 10.1051/ps:2005018 …

Error bounds for approximations with deep ReLU networks

D Yarotsky - Neural networks, 2017 - Elsevier
We study expressive power of shallow and deep neural networks with piece-wise linear
activation functions. We establish new rigorous upper and lower bounds for the network …

Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networks

PL Bartlett, N Harvey, C Liaw, A Mehrabian - Journal of Machine Learning …, 2019 - jmlr.org
We prove new upper and lower bounds on the VC-dimension of deep neural networks with
the ReLU activation function. These bounds are tight for almost the entire range of …

Optimal approximation of continuous functions by very deep ReLU networks

D Yarotsky - Conference on learning theory, 2018 - proceedings.mlr.press
We consider approximations of general continuous functions on finite-dimensional cubes by
general deep ReLU neural networks and study the approximation rates with respect to the …

Learning quantum states and unitaries of bounded gate complexity

H Zhao, L Lewis, I Kannan, Y Quek, HY Huang… - PRX Quantum, 2024 - APS
While quantum state tomography is notoriously hard, most states hold little interest to
practically minded tomographers. Given that states and unitaries appearing in nature are of …

Recent advances in deep learning theory

F He, D Tao - arxiv preprint arxiv:2012.10931, 2020 - arxiv.org
Deep learning is usually described as an experiment-driven field under continuous criticizes
of lacking theoretical foundations. This problem has been partially fixed by a large volume of …

Networks of spiking neurons: the third generation of neural network models

W Maass - Neural networks, 1997 - Elsevier
The computational power of formal models for networks of spiking neurons is compared with
that of other neural network models based on McCulloch Pitts neurons (ie, threshold gates) …

On discriminative vs. generative classifiers: A comparison of logistic regression and naive bayes

A Ng, M Jordan - Advances in neural information …, 2001 - proceedings.neurips.cc
We compare discriminative and generative learning as typified by logistic regression and
naive Bayes. We show, contrary to a widely (cid: 173) held belief that discriminative …

[CARTE][B] A probabilistic theory of pattern recognition

L Devroye, L Györfi, G Lugosi - 2013 - books.google.com
Pattern recognition presents one of the most significant challenges for scientists and
engineers, and many different approaches have been proposed. The aim of this book is to …

[CARTE][B] Neural network learning: Theoretical foundations

M Anthony, PL Bartlett - 2009 - dl.acm.org
This important work describes recent theoretical advances in the study of artificial neural
networks. It explores probabilistic models of supervised learning problems, and addresses …