Stochastic gradient descent with noise of machine learning type part i: Discrete time analysis

S Wojtowytsch - Journal of Nonlinear Science, 2023 - Springer
Stochastic gradient descent (SGD) is one of the most popular algorithms in modern machine
learning. The noise encountered in these applications is different from that in many …

Hypocoercivity without confinement

E Bouin, J Dolbeault, S Mischler, C Mouhot… - Pure and Applied …, 2020 - msp.org
Hypocoercivity methods are applied to linear kinetic equations with mass conservation and
without confinement in order to prove that the solutions have an algebraic decay rate in the …

Stochastic gradient descent with noise of machine learning type part ii: Continuous time analysis

S Wojtowytsch - Journal of Nonlinear Science, 2024 - Springer
The representation of functions by artificial neural networks depends on a large number of
parameters in a non-linear fashion. Suitable parameters are found by minimizing a 'loss …

Remarks on the Hardy type inequalities with remainder terms in the framework of equalities

S Machihara, T Ozawa, H Wadade - Asymptotic analysis for …, 2019 - projecteuclid.org
We study the Hardy type inequalities in the framework of equalities. We present equalities
which immediately imply Hardy type inequalities by drop** the remainder term …

Logarithmic Sobolev, Hardy and Poincar\'e inequalities on the Heisenberg group

M Chatzakou, A Kassymov, M Ruzhansky - arxiv preprint arxiv …, 2023 - arxiv.org
In this paper we first prove a number of important inequalities with explicit constants in the
setting of the Heisenberg group. This includes the fractional and integer Sobolev, Gagliardo …

A unified divergent approach to Hardy–Poincaré inequalities in classical and variable Sobolev spaces

G Di Fratta, A Fiorenza - Journal of Functional Analysis, 2022 - Elsevier
We present a unified strategy to derive Hardy–Poincaré inequalities on bounded and
unbounded domains. The approach allows proving a general Hardy–Poincaré inequality …

First order Hardy inequalities revisited

X Huang, D Ye - arxiv preprint arxiv:2109.05471, 2021 - arxiv.org
In this paper, we consider the first order Hardy inequalities using simple equalities. This
basic setting not only permits to derive quickly many well-known Hardy inequalities with …