Stochastic gradient descent: Recent trends

D Newton, F Yousefian… - Recent advances in …, 2018 - pubsonline.informs.org
Stochastic gradient descent (SGD), also known as stochastic approximation, refers to certain
simple iterative structures used for solving stochastic optimization and root-finding problems …

Tight last-iterate convergence rates for no-regret learning in multi-player games

N Golowich, S Pattathil… - Advances in neural …, 2020 - proceedings.neurips.cc
We study the question of obtaining last-iterate convergence rates for no-regret learning
algorithms in multi-player games. We show that the optimistic gradient (OG) algorithm with a …

Convergence of stochastic proximal gradient algorithm

L Rosasco, S Villa, BC Vũ - Applied Mathematics & Optimization, 2020 - Springer
We study the extension of the proximal gradient algorithm where only a stochastic gradient
estimate is available and a relaxation step is allowed. We establish convergence rates for …

Distributed variable sample-size gradient-response and best-response schemes for stochastic Nash equilibrium problems

J Lei, UV Shanbhag - SIAM Journal on Optimization, 2022 - SIAM
This paper considers an n-player stochastic Nash equilibrium problem (NEP) in which the i
th player minimizes a composite objective f_i(∙,x_-i)+r_i(∙), where f_i is an expectation-valued …

Primal dual interpretation of the proximal stochastic gradient Langevin algorithm

A Salim, P Richtarik - Advances in Neural Information …, 2020 - proceedings.neurips.cc
We consider the task of sampling with respect to a log concave probability distribution. The
potential of the target distribution is assumed to be composite, ie, written as the sum of a …

Minibatch forward-backward-forward methods for solving stochastic variational inequalities

RI Boţ, P Mertikopoulos, M Staudigl… - Stochastic …, 2021 - pubsonline.informs.org
We develop a new stochastic algorithm for solving pseudomonotone stochastic variational
inequalities. Our method builds on Tseng's forward-backward-forward algorithm, which is …

Application of adaptive Lasso-based minimum entropy deconvolution for bearing fault detection

Y Sun, Y Zhao, Q Shi, J Cao, J Wei - IEEE Sensors Journal, 2024 - ieeexplore.ieee.org
Minimum entropy deconvolution (MED) and its related methods have been applied to
bearing fault detection extensively due to their good performance in fault feature …

Adaptive k-sparsity-based weighted lasso for bearing fault detection

Y Sun, J Yu - IEEE Sensors Journal, 2022 - ieeexplore.ieee.org
Vibration monitoring is widely used for machinery fault detection as one of the most effective
and common methods. However, it is difficult to extract fault features from the vibration …

A distributed forward–backward algorithm for stochastic generalized Nash equilibrium seeking

B Franci, S Grammatico - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
We consider the stochastic generalized Nash equilibrium problem (SGNEP) with expected-
value cost functions. Inspired by Yi and Pavel (2019), we propose a distributed generalized …

Stochastic fixed-point iterations for nonexpansive maps: Convergence and error bounds

M Bravo, R Cominetti - SIAM Journal on Control and Optimization, 2024 - SIAM
We study a stochastically perturbed version of the well-known Krasnoselskii–Mann iteration
for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We …