Theoretically principled trade-off between robustness and accuracy
We identify a trade-off between robustness and accuracy that serves as a guiding principle
in the design of defenses against adversarial examples. Although this problem has been …
in the design of defenses against adversarial examples. Although this problem has been …
Breaking the curse of dimensionality with convex neural networks
F Bach - Journal of Machine Learning Research, 2017 - jmlr.org
We consider neural networks with a single hidden layer and non-decreasing positively
homogeneous activation functions like the rectified linear units. By letting the number of …
homogeneous activation functions like the rectified linear units. By letting the number of …
Stronger data poisoning attacks break data sanitization defenses
Abstract Machine learning models trained on data from the outside world can be corrupted
by data poisoning attacks that inject malicious points into the models' training sets. A …
by data poisoning attacks that inject malicious points into the models' training sets. A …
Learning from untrusted data
The vast majority of theoretical results in machine learning and statistics assume that the
training data is a reliable reflection of the phenomena to be learned. Similarly, most learning …
training data is a reliable reflection of the phenomena to be learned. Similarly, most learning …
MODE: automated neural network model debugging via state differential analysis and input selection
Artificial intelligence models are becoming an integral part of modern computing systems.
Just like software inevitably has bugs, models have bugs too, leading to poor classification …
Just like software inevitably has bugs, models have bugs too, leading to poor classification …
Who should predict? exact algorithms for learning to defer to humans
Automated AI classifiers should be able to defer the prediction to a human decision maker to
ensure more accurate predictions. In this work, we jointly train a classifier with a rejector …
ensure more accurate predictions. In this work, we jointly train a classifier with a rejector …
Theory of disagreement-based active learning
S Hanneke - Foundations and Trends® in Machine Learning, 2014 - nowpublishers.com
Active learning is a protocol for supervised machine learning, in which a learning algorithm
sequentially requests the labels of selected data points from a large pool of unlabeled data …
sequentially requests the labels of selected data points from a large pool of unlabeled data …
A general agnostic active learning algorithm
We present an agnostic active learning algorithm for any hypothesis class of bounded VC
dimension under arbitrary data distributions. Most previ-ous work on active learning either …
dimension under arbitrary data distributions. Most previ-ous work on active learning either …
Agnostically learning halfspaces
We give a computationally efficient algorithm that learns (under distributional assumptions) a
halfspace in the difficult agnostic framework of Kearns, Schapire, and Sellie Mach. Learn …
halfspace in the difficult agnostic framework of Kearns, Schapire, and Sellie Mach. Learn …
Online bayesian persuasion
In Bayesian persuasion, an informed sender has to design a signaling scheme that
discloses the right amount of information so as to influence the behavior of a self-interested …
discloses the right amount of information so as to influence the behavior of a self-interested …