Statistics of robust optimization: A generalized empirical likelihood approach

JC Duchi, PW Glynn… - Mathematics of Operations …, 2021 - pubsonline.informs.org
We study statistical inference and distributionally robust solution methods for stochastic
optimization problems, focusing on confidence intervals for optimal values and solutions that …

On linear stochastic approximation: Fine-grained Polyak-Ruppert and non-asymptotic concentration

W Mou, CJ Li, MJ Wainwright… - … on Learning Theory, 2020 - proceedings.mlr.press
We undertake a precise study of the asymptotic and non-asymptotic properties of stochastic
approximation procedures with Polyak-Ruppert averaging for solving a linear system $\bar …

Reducing communication in federated learning via efficient client sampling

M Ribero, H Vikalo - Pattern Recognition, 2024 - Elsevier
Federated learning (FL) ameliorates privacy concerns in settings where a central server
coordinates learning from data distributed across many clients; rather than sharing the data …

Statistical estimation and online inference via local sgd

X Li, J Liang, X Chang, Z Zhang - Conference on Learning …, 2022 - proceedings.mlr.press
We analyze the novel Local SGD in federated Learning, a multi-round estimation procedure
that uses intermittent communication to improve communication efficiency. Under a $2 …

Online statistical inference for nonlinear stochastic approximation with markovian data

X Li, J Liang, Z Zhang - arxiv preprint arxiv:2302.07690, 2023 - arxiv.org
We study the statistical inference of nonlinear stochastic approximation algorithms utilizing a
single trajectory of Markovian data. Our methodology has practical applications in various …

Online bootstrap inference for policy evaluation in reinforcement learning

P Ramprasad, Y Li, Z Yang, Z Wang… - Journal of the …, 2023 - Taylor & Francis
The recent emergence of reinforcement learning (RL) has created a demand for robust
statistical inference methods for the parameter estimates computed using these algorithms …

Forecasting the capacity of open-ended pipe piles using machine learning

B Ozturk, A Kodsy, M Iskander - Infrastructures, 2023 - mdpi.com
Pile design is an essential component of geotechnical engineering practice, and pipe piles,
in particular, are increasingly being used for the support of a variety of infrastructure projects …

Stochastic gradient and Langevin processes

X Cheng, D Yin, P Bartlett… - … Conference on Machine …, 2020 - proceedings.mlr.press
We prove quantitative convergence rates at which discrete Langevin-like processes
converge to the invariant distribution of a related stochastic differential equation. We study …

The collusion of memory and nonlinearity in stochastic approximation with constant stepsize

D Huo, Y Zhang, Y Chen, Q **e - arxiv preprint arxiv:2405.16732, 2024 - arxiv.org
In this work, we investigate stochastic approximation (SA) with Markovian data and
nonlinear updates under constant stepsize $\alpha> 0$. Existing work has primarily focused …

Uncertainty quantification for online learning and stochastic approximation via hierarchical incremental gradient descent

WJ Su, Y Zhu - arxiv preprint arxiv:1802.04876, 2018 - arxiv.org
Stochastic gradient descent (SGD) is an immensely popular approach for online learning in
settings where data arrives in a stream or data sizes are very large. However, despite an …