Consensus-based optimization methods converge globally
In this paper we study consensus-based optimization (CBO), which is a multiagent
metaheuristic derivative-free optimization method that can globally minimize nonconvex …
metaheuristic derivative-free optimization method that can globally minimize nonconvex …
Revisiting sampling for combinatorial optimization
Sampling approaches like Markov chain Monte Carlo were once popular for combinatorial
optimization, but the inefficiency of classical methods and the need for problem-specific …
optimization, but the inefficiency of classical methods and the need for problem-specific …
Appropriate noise addition to metaheuristic algorithms can enhance their performance
Nature-inspired swarm-based algorithms are increasingly applied to tackle high-
dimensional and complex optimization problems across disciplines. They are general …
dimensional and complex optimization problems across disciplines. They are general …
Stochastic Anderson mixing for nonconvex stochastic optimization
Anderson mixing (AM) is an acceleration method for fixed-point iterations. Despite its
success and wide usage in scientific computing, the convergence theory of AM remains …
success and wide usage in scientific computing, the convergence theory of AM remains …
State-dependent temperature control for Langevin diffusions
We study the temperature control problem for Langevin diffusions in the context of
nonconvex optimization. The classical optimal control of such a problem is of the bang-bang …
nonconvex optimization. The classical optimal control of such a problem is of the bang-bang …
Failure of smooth pasting principle and nonexistence of equilibrium stop** rules under time-inconsistency
This paper considers time-inconsistent stop** problems in which the inconsistency arises
from a class of nonexponential discount functions called weighted discount functions. We …
from a class of nonexponential discount functions called weighted discount functions. We …
Maximum entropy differential dynamic programming
In this paper, we present a novel maximum entropy formulation of the Differential Dynamic
Programming algorithm and derive two variants using unimodal and multimodal value …
Programming algorithm and derive two variants using unimodal and multimodal value …
On stationary-point hitting time and ergodicity of stochastic gradient Langevin dynamics
Stochastic gradient Langevin dynamics (SGLD) is a fundamental algorithm in stochastic
optimization. Recent work by Zhang et al.(2017) presents an analysis for the hitting time of …
optimization. Recent work by Zhang et al.(2017) presents an analysis for the hitting time of …
Second-Order Stein Variational Dynamic Optimization
We present a novel second-order trajectory optimization algorithm based on Stein
Variational Newton's Method and Maximum Entropy Differential Dynamic Programming. The …
Variational Newton's Method and Maximum Entropy Differential Dynamic Programming. The …
PCA matrix denoising is uniform
Principal component analysis (PCA) is a simple and popular tool for processing high-
dimensional data. We investigate its effectiveness for matrix denoising. We assume iid high …
dimensional data. We investigate its effectiveness for matrix denoising. We assume iid high …