Advances in asynchronous parallel and distributed optimization

M Assran, A Aytekin, HR Feyzmahdavian… - Proceedings of the …, 2020 - ieeexplore.ieee.org
Motivated by large-scale optimization problems arising in the context of machine learning,
there have been several advances in the study of asynchronous parallel and distributed …

A linear algorithm for optimization over directed graphs with geometric convergence

R **n, UA Khan - IEEE Control Systems Letters, 2018 - ieeexplore.ieee.org
In this letter, we study distributed optimization, where a network of agents, abstracted as a
directed graph, collaborates to minimize the average of locally known convex functions …

A general framework for decentralized optimization with first-order methods

R **n, S Pu, A Nedić, UA Khan - Proceedings of the IEEE, 2020 - ieeexplore.ieee.org
Decentralized optimization to minimize a finite sum of functions, distributed over a network of
nodes, has been a significant area within control and signal-processing research due to its …

Machine learning for Gravity Spy: Glitch classification and dataset

S Bahaadini, V Noroozi, N Rohani, S Coughlin… - Information …, 2018 - Elsevier
The detection of gravitational waves with ground-based laser-interferometric detectors
requires sensitivity to changes in distance much smaller than the diameter of atomic nuclei …

Balancing communication and computation in distributed optimization

AS Berahas, R Bollapragada… - IEEE Transactions on …, 2018 - ieeexplore.ieee.org
Methods for distributed optimization have received significant attention in recent years owing
to their wide applicability in various domains including machine learning, robotics, and …

Asynchronous gradient push

MS Assran, MG Rabbat - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
We consider a multiagent framework for distributed optimization where each agent has
access to a local smooth strongly convex function, and the collective goal is to achieve …

A numerical Bayesian-calibrated characterization method for multiscale prepreg preforming simulations with tension-shear coupling

W Zhang, R Bostanabad, B Liang, X Su, D Zeng… - … Science and Technology, 2019 - Elsevier
Carbon fiber reinforced plastics (CFRPs) are attracting growing attention in industry because
of their enhanced properties. Preforming of thermoset carbon fiber prepregs is one of the …

A fast distributed asynchronous Newton-based optimization algorithm

F Mansoori, E Wei - IEEE Transactions on Automatic Control, 2019 - ieeexplore.ieee.org
One of the most important problems in the field of distributed optimization is the problem of
minimizing a sum of local convex objective functions over a networked system. Most of the …

Robust asynchronous stochastic gradient-push: Asymptotically optimal and network-independent performance for strongly convex functions

A Spiridonoff, A Olshevsky, IC Paschalidis - Journal of machine learning …, 2020 - jmlr.org
We consider the standard model of distributed optimization of a sum of functions F (z)= Σ ni=
1 fi (z), where node i in a network holds the function fi (z). We allow for a harsh network …

A primal-dual quasi-Newton method for exact consensus optimization

M Eisen, A Mokhtari, A Ribeiro - IEEE Transactions on Signal …, 2019 - ieeexplore.ieee.org
We introduce the primal-dual quasi-Newton (PD-QN) method as an approximated second
order method for solving decentralized optimization problems. The PD-QN method performs …