Fundamental research and developments in the field of applied artificial intelligence
The present stage of development of artificial intelligence (AI) is based on advanced
technologies and modern methods and algorithms of machine learning (ML) including deep …
technologies and modern methods and algorithms of machine learning (ML) including deep …
AdaFisher: Adaptive Second Order Optimization via Fisher Information
First-order optimization methods are currently the mainstream in training deep neural
networks (DNNs). Optimizers like Adam incorporate limited curvature information by …
networks (DNNs). Optimizers like Adam incorporate limited curvature information by …
Another approach to build Lyapunov functions for the first order methods in the quadratic case
Lyapunov functions play a fundamental role in analyzing the stability and convergence
properties of optimization methods. In this paper, we propose a novel and straightforward …
properties of optimization methods. In this paper, we propose a novel and straightforward …