A primer on zeroth-order optimization in signal processing and machine learning: Principals, recent advances, and applications

S Liu, PY Chen, B Kailkhura, G Zhang… - IEEE Signal …, 2020 - ieeexplore.ieee.org
Zeroth-order (ZO) optimization is a subset of gradient-free optimization that emerges in many
signal processing and machine learning (ML) applications. It is used for solving optimization …

Threats to training: A survey of poisoning attacks and defenses on machine learning systems

Z Wang, J Ma, X Wang, J Hu, Z Qin, K Ren - ACM Computing Surveys, 2022 - dl.acm.org
Machine learning (ML) has been universally adopted for automated decisions in a variety of
fields, including recognition and classification applications, recommendation systems …

Just how toxic is data poisoning? a unified benchmark for backdoor and data poisoning attacks

A Schwarzschild, M Goldblum… - International …, 2021 - proceedings.mlr.press
Data poisoning and backdoor attacks manipulate training data in order to cause models to
fail during inference. A recent survey of industry practitioners found that data poisoning is the …

Robust unlearnable examples: Protecting data against adversarial learning

S Fu, F He, Y Liu, L Shen, D Tao - arxiv preprint arxiv:2203.14533, 2022 - arxiv.org
The tremendous amount of accessible data in cyberspace face the risk of being
unauthorized used for training deep learning models. To address this concern, methods are …

An empirical survey on explainable ai technologies: Recent trends, use-cases, and categories from technical and application perspectives

M Nagahisarchoghaei, N Nur, L Cummins, N Nur… - Electronics, 2023 - mdpi.com
In a wide range of industries and academic fields, artificial intelligence is becoming
increasingly prevalent. AI models are taking on more crucial decision-making tasks as they …

Cuda: Convolution-based unlearnable datasets

VS Sadasivan, M Soltanolkotabi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Large-scale training of modern deep learning models heavily relies on publicly available
data on the web. This potentially unauthorized usage of online data leads to concerns …

Nonconvex min-max optimization: Applications, challenges, and recent theoretical advances

M Razaviyayn, T Huang, S Lu… - IEEE Signal …, 2020 - ieeexplore.ieee.org
The min-max optimization problem, also known as the<; i> saddle point problem<;/i>, is a
classical optimization problem that is also studied in the context of zero-sum games. Given a …

Faster single-loop algorithms for minimax optimization without strong concavity

J Yang, A Orvieto, A Lucchi… - … Conference on Artificial …, 2022 - proceedings.mlr.press
Gradient descent ascent (GDA), the simplest single-loop algorithm for nonconvex minimax
optimization, is widely used in practical applications such as generative adversarial …

Stochastic gradient descent-ascent: Unified theory and new efficient methods

A Beznosikov, E Gorbunov… - International …, 2023 - proceedings.mlr.press
Abstract Stochastic Gradient Descent-Ascent (SGDA) is one of the most prominent
algorithms for solving min-max optimization and variational inequalities problems (VIP) …

The limits of min-max optimization algorithms: Convergence to spurious non-critical sets

YP Hsieh, P Mertikopoulos… - … Conference on Machine …, 2021 - proceedings.mlr.press
Compared to minimization, the min-max optimization in machine learning applications is
considerably more convoluted because of the existence of cycles and similar phenomena …