A survey of optimization methods from a machine learning perspective

S Sun, Z Cao, H Zhu, J Zhao - IEEE transactions on cybernetics, 2019 - ieeexplore.ieee.org
Machine learning develops rapidly, which has made many theoretical breakthroughs and is
widely applied in various fields. Optimization, as an important part of machine learning, has …

A brief introduction to manifold optimization

J Hu, X Liu, ZW Wen, YX Yuan - … of the Operations Research Society of …, 2020 - Springer
Manifold optimization is ubiquitous in computational and applied mathematics, statistics,
engineering, machine learning, physics, chemistry, etc. One of the main challenges usually …

Re-parameterizing your optimizers rather than architectures

X Ding, H Chen, X Zhang, K Huang, J Han… - arxiv preprint arxiv …, 2022 - arxiv.org
The well-designed structures in neural networks reflect the prior knowledge incorporated
into the models. However, though different models have various priors, we are used to …

Minimum-distortion embedding

A Agrawal, A Ali, S Boyd - Foundations and Trends® in …, 2021 - nowpublishers.com
We consider the vector embedding problem. We are given a finite set of items, with the goal
of assigning a representative vector to each one, possibly under some constraints (such as …

Projection robust Wasserstein distance and Riemannian optimization

T Lin, C Fan, N Ho, M Cuturi… - Advances in neural …, 2020 - proceedings.neurips.cc
Projection robust Wasserstein (PRW) distance, or Wasserstein projection pursuit (WPP), is a
robust variant of the Wasserstein distance. Recent work suggests that this quantity is more …

First-order algorithms for min-max optimization in geodesic metric spaces

M Jordan, T Lin… - Advances in Neural …, 2022 - proceedings.neurips.cc
From optimal transport to robust dimensionality reduction, many machine learning
applicationscan be cast into the min-max optimization problems over Riemannian manifolds …

Numerical methods for Kohn–Sham density functional theory

L Lin, J Lu, L Ying - Acta Numerica, 2019 - cambridge.org
Kohn–Sham density functional theory (DFT) is the most widely used electronic structure
theory. Despite significant progress in the past few decades, the numerical solution of Kohn …

Decentralized optimization over the Stiefel manifold by an approximate augmented Lagrangian function

L Wang, X Liu - IEEE Transactions on Signal Processing, 2022 - ieeexplore.ieee.org
In this paper, we focus on the decentralized optimization problem over the Stiefel manifold,
which is defined on a connected network of agents. The objective is an average of local …

KSSOLV 2.0: An efficient MATLAB toolbox for solving the Kohn-Sham equations with plane-wave basis set

S Jiao, Z Zhang, K Wu, L Wan, H Ma, J Li… - Computer Physics …, 2022 - Elsevier
Abstract KSSOLV (Kohn-Sham Solver) is a MATLAB toolbox for performing Kohn-Sham
density functional theory (DFT) calculations with a plane-wave basis set. KSSOLV 2.0 …

Parameter optimization for point clouds denoising based on no-reference quality assessment

C Qu, Y Zhang, F Ma, K Huang - Measurement, 2023 - Elsevier
Almost all point clouds denoising methods contain various parameters, which need to be set
carefully to acquire desired results. In this paper, we introduce an evolutionary optimization …