A survey on some recent developments of alternating direction method of multipliers

DR Han - Journal of the Operations Research Society of China, 2022 - Springer
Recently, alternating direction method of multipliers (ADMM) attracts much attentions from
various fields and there are many variant versions tailored for different models. Moreover, its …

Efficient and accurate estimation of lipschitz constants for deep neural networks

M Fazlyab, A Robey, H Hassani… - Advances in neural …, 2019 - proceedings.neurips.cc
Tight estimation of the Lipschitz constant for deep neural networks (DNNs) is useful in many
applications ranging from robustness certification of classifiers to stability analysis of closed …

Acceleration methods

A d'Aspremont, D Scieur, A Taylor - Foundations and Trends® …, 2021 - nowpublishers.com
This monograph covers some recent advances in a range of acceleration techniques
frequently used in convex optimization. We first use quadratic optimization problems to …

Plug-and-play methods provably converge with properly trained denoisers

E Ryu, J Liu, S Wang, X Chen… - … on Machine Learning, 2019 - proceedings.mlr.press
Abstract Plug-and-play (PnP) is a non-convex framework that integrates modern denoising
priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal …

FedSplit: An algorithmic framework for fast federated optimization

R Pathak, MJ Wainwright - Advances in neural information …, 2020 - proceedings.neurips.cc
Motivated by federated learning, we consider the hub-and-spoke model of distributed
optimization in which a central authority coordinates the computation of a solution among …

Spiking control systems

R Sepulchre - Proceedings of the IEEE, 2022 - ieeexplore.ieee.org
Spikes and rhythms organize control and communication in the animal world, in contrast to
the bits and clocks of digital technology. As continuous-time signals that can be counted …

An online plug-and-play algorithm for regularized image reconstruction

Y Sun, B Wohlberg, US Kamilov - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Plug-and-play priors (PnP) is a powerful framework for regularizing imaging inverse
problems by using advanced denoisers within an iterative algorithm. Recent experimental …

Monotone operator equilibrium networks

E Winston, JZ Kolter - Advances in neural information …, 2020 - proceedings.neurips.cc
Implicit-depth models such as Deep Equilibrium Networks have recently been shown to
match or exceed the performance of traditional deep networks while being much more …

Plug-and-play unplugged: Optimization-free reconstruction using consensus equilibrium

GT Buzzard, SH Chan, S Sreehari, CA Bouman - SIAM Journal on Imaging …, 2018 - SIAM
Regularized inversion methods for image reconstruction are used widely due to their
tractability and their ability to combine complex physical sensor models with useful regularity …

Sample efficient reinforcement learning with REINFORCE

J Zhang, J Kim, B O'Donoghue, S Boyd - Proceedings of the AAAI …, 2021 - ojs.aaai.org
Policy gradient methods are among the most effective methods for large-scale reinforcement
learning, and their empirical success has prompted several works that develop the …