A consensus-based global optimization method for high dimensional machine learning problems

JA Carrillo, S **, L Li, Y Zhu - ESAIM: Control, Optimisation and …, 2021 - esaim-cocv.org
We improve recently introduced consensus-based optimization method, proposed in [R.
Pinnau, C. Totzeck, O. Tse, S. Martin, Math. Models Methods Appl. Sci. 27 (2017) 183–204] …

Asymptotic-preserving schemes for multiscale physical problems

S ** - Acta Numerica, 2022 - cambridge.org
We present the asymptotic transitions from microscopic to macroscopic physics, their
computational challenges and the asymptotic-preserving (AP) strategies to compute …

On the global convergence of particle swarm optimization methods

H Huang, J Qiu, K Riedl - Applied Mathematics & Optimization, 2023 - Springer
In this paper we provide a rigorous convergence analysis for the renowned particle swarm
optimization method by using tools from stochastic calculus and the analysis of partial …

Consensus-based optimization on the sphere: Convergence to global minimizers and machine learning

M Fornasier, L Pareschi, H Huang, P Sünnen - Journal of Machine …, 2021 - jmlr.org
We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for
global optimization of nonconvex functions on the sphere. This model belongs to the class of …

A screening condition imposed stochastic approximation for long-range electrostatic correlations

W Gao, Z Hu, Z Xu - Journal of Chemical Theory and Computation, 2023 - ACS Publications
The recent random batch Ewald algorithm, originating from a stochastic approximation,
performs 1 order of magnitude faster than the mainstream algorithms such as the particle …

Trends in consensus-based optimization

C Totzeck - Active Particles, Volume 3: Advances in Theory …, 2021 - Springer
In this chapter we give an overview of the consensus-based global optimization algorithm
and its recent variants. We recall the formulation and analytical results of the original model …

From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit

S Grassi, L Pareschi - Mathematical Models and Methods in Applied …, 2021 - World Scientific
In this paper, we consider a continuous description based on stochastic differential
equations of the popular particle swarm optimization (PSO) process for solving global …

Constrained consensus-based optimization

G Borghi, M Herty, L Pareschi - SIAM Journal on Optimization, 2023 - SIAM
In this work we are interested in the construction of numerical methods for high-dimensional
constrained nonlinear optimization problems by particle-based gradient-free techniques. A …

Provably fast finite particle variants of svgd via virtual particle stochastic approximation

A Das, D Nagaraj - Advances in Neural Information …, 2023 - proceedings.neurips.cc
Abstract Stein Variational Gradient Descent (SVGD) is a popular particle-based variational
inference algorithm with impressive empirical performance across various domains …

A random batch Ewald method for particle systems with Coulomb interactions

S **, L Li, Z Xu, Y Zhao - SIAM Journal on Scientific Computing, 2021 - SIAM
We develop a random batch Ewald (RBE) method for molecular dynamics simulations of
particle systems with long-range Coulomb interactions, which achieves an O(N) complexity …