Universal regularization methods: varying the power, the smoothness and the accuracy

C Cartis, NI Gould, PL Toint - SIAM Journal on Optimization, 2019 - SIAM
Adaptive cubic regularization methods have emerged as a credible alternative to linesearch
and trust-region for smooth nonconvex optimization, with optimal complexity amongst …

A Sub-sampled Tensor Method for Non-convex Optimization

A Lucchi, J Kohler - arxiv preprint arxiv:1911.10367, 2019 - arxiv.org
We present a stochastic optimization method that uses a fourth-order regularized model to
find local minima of smooth and potentially non-convex objective functions with a finite-sum …

[PDF][PDF] Global convergence of high-order regularization methods with sums-of-squares Taylor models

C Cartis, W Zhu - arxiv preprint arxiv:2404.03035, 2024 - researchgate.net
High-order tensor methods that employ Taylor-based local models (of degree p≥ 3) within
adaptive regularization frameworks have been recently proposed for both convex and …

Convergence and evaluation-complexity analysis of a regularized tensor-Newton method for solving nonlinear least-squares problems

NIM Gould, T Rees, JA Scott - Computational Optimization and …, 2019 - Springer
Given a twice-continuously differentiable vector-valued function r (x), a local minimizer of ‖ r
(x) ‖ _2‖ r (x)‖ 2 is sought. We propose and analyse tensor-Newton methods, in which r …

A sub-sampled tensor method for nonconvex optimization

A Lucchi, J Kohler - IMA Journal of Numerical Analysis, 2023 - academic.oup.com
A significant theoretical advantage of high-order optimization methods is their superior
convergence guarantees. For instance, third-order regularized methods reach an third-order …

Global Convergence of High-Order Regularization Methods with Sums-of-Squares Taylor Models

W Zhu, C Cartis - arxiv preprint arxiv:2404.03035, 2024 - arxiv.org
High-order tensor methods that employ Taylor-based local models (of degree $ p\ge 3$)
within adaptive regularization frameworks have been recently proposed for both convex and …

Complexity analysis of regularization methods for implicitly constrained least squares

A Onwunta, CW Royer - Journal of Scientific Computing, 2024 - Springer
Optimization problems constrained by partial differential equations (PDEs) naturally arise in
scientific computing, as those constraints often model physical systems or the simulation …

Second-order adjoint sensitivities for fluorescence optical tomography based on the SPN approximation

N Patil, N Naik - JOSA A, 2019 - opg.optica.org
Use of second-order sensitivity information has been shown in the literature to yield faster
convergence, better noise tolerance, and localization besides enhanced post-reconstruction …

[PDF][PDF] VYUŽITIE METÓD NELINEÁRNEJ REGRESIE NA MODELOVANIE ÚMRTNOSTI POPULÁCIE USE OF NONLINEAR REGRESSION METHODS FOR THE …

T Šoltésová, E Šoltés - … VO VEDECKOVÝSKUMNEJ ČINNOSTI AV PRAXI XV - fhi.euba.sk
The aim of the article is to refer the use of regression analysis to estimate the parameters of
selected parametric mortality models, known as mortality laws. We are looking at mortality …

Tensor-Newton Reconstruction Scheme for Fluorescence Optical Tomography

N Patil, N Naik - 2019 PhotonIcs & Electromagnetics Research …, 2019 - ieeexplore.ieee.org
In this work, we set up the use of a Tensor-Newton scheme for solving the nonlinear
reconstruction problem for the fluorophore absorption coefficient, μaf x in SPN modeled …