A survey on some recent developments of alternating direction method of multipliers
DR Han - Journal of the Operations Research Society of China, 2022 - Springer
Recently, alternating direction method of multipliers (ADMM) attracts much attentions from
various fields and there are many variant versions tailored for different models. Moreover, its …
various fields and there are many variant versions tailored for different models. Moreover, its …
Efficient and accurate estimation of lipschitz constants for deep neural networks
Tight estimation of the Lipschitz constant for deep neural networks (DNNs) is useful in many
applications ranging from robustness certification of classifiers to stability analysis of closed …
applications ranging from robustness certification of classifiers to stability analysis of closed …
Acceleration methods
This monograph covers some recent advances in a range of acceleration techniques
frequently used in convex optimization. We first use quadratic optimization problems to …
frequently used in convex optimization. We first use quadratic optimization problems to …
Plug-and-play methods provably converge with properly trained denoisers
Abstract Plug-and-play (PnP) is a non-convex framework that integrates modern denoising
priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal …
priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal …
FedSplit: An algorithmic framework for fast federated optimization
R Pathak, MJ Wainwright - Advances in neural information …, 2020 - proceedings.neurips.cc
Motivated by federated learning, we consider the hub-and-spoke model of distributed
optimization in which a central authority coordinates the computation of a solution among …
optimization in which a central authority coordinates the computation of a solution among …
Spiking control systems
R Sepulchre - Proceedings of the IEEE, 2022 - ieeexplore.ieee.org
Spikes and rhythms organize control and communication in the animal world, in contrast to
the bits and clocks of digital technology. As continuous-time signals that can be counted …
the bits and clocks of digital technology. As continuous-time signals that can be counted …
An online plug-and-play algorithm for regularized image reconstruction
Plug-and-play priors (PnP) is a powerful framework for regularizing imaging inverse
problems by using advanced denoisers within an iterative algorithm. Recent experimental …
problems by using advanced denoisers within an iterative algorithm. Recent experimental …
Monotone operator equilibrium networks
E Winston, JZ Kolter - Advances in neural information …, 2020 - proceedings.neurips.cc
Implicit-depth models such as Deep Equilibrium Networks have recently been shown to
match or exceed the performance of traditional deep networks while being much more …
match or exceed the performance of traditional deep networks while being much more …
Plug-and-play unplugged: Optimization-free reconstruction using consensus equilibrium
Regularized inversion methods for image reconstruction are used widely due to their
tractability and their ability to combine complex physical sensor models with useful regularity …
tractability and their ability to combine complex physical sensor models with useful regularity …
Sample efficient reinforcement learning with REINFORCE
Policy gradient methods are among the most effective methods for large-scale reinforcement
learning, and their empirical success has prompted several works that develop the …
learning, and their empirical success has prompted several works that develop the …