On learning gaussian multi-index models with gradient flow

A Bietti, J Bruna, L Pillaud-Vivien - arxiv preprint arxiv:2310.19793, 2023 - arxiv.org
We study gradient flow on the multi-index regression problem for high-dimensional
Gaussian data. Multi-index functions consist of a composition of an unknown low-rank linear …

[HTML][HTML] The approximation operators with sigmoidal functions

Z Chen, F Cao - Computers & Mathematics with Applications, 2009 - Elsevier
The aim of this paper is to investigate the error which results from the method of
approximation operators with logarithmic sigmoidal function. By means of the method of …

Multivariate sigmoidal neural network approximation

GA Anastassiou - Neural Networks, 2011 - Elsevier
Here we study the multivariate quantitative constructive approximation of real and complex
valued continuous multivariate functions on a box or RN, N∈ N, by the multivariate quasi …

Univariate Sigmoidal Neural Network Quantitative Approximation

GA Anastassiou, GA Anastassiou - Intelligent Systems: Approximation by …, 2011 - Springer
Here we give the univariate quantitative approximation of real and complex valued
continuous functions on a compact interval or all the real line by quasi-interpolation …

Rates of approximation by neural network interpolation operators

Y Qian, D Yu - Applied Mathematics and Computation, 2022 - Elsevier
We construct neural network interpolation operators with some newly defined activation
functions, and give the approximation rate by the operators for continuous functions. By …

Neural network interpolation operators optimized by Lagrange polynomial

G Wang, D Yu, P Zhou - Neural Networks, 2022 - Elsevier
In this paper, we introduce a new type of interpolation operators by using Lagrange
polynomials of degree r, which can be regarded as feedforward neural networks with four …

Approximation of conditional densities by smooth mixtures of regressions

A Norets - 2010 - projecteuclid.org
This paper shows that large nonparametric classes of conditional multivariate densities can
be approximated in the Kullback–Leibler distance by different specifications of finite mixtures …

An adaptive optimization scheme with satisfactory transient performance

EB Kosmatopoulos - Automatica, 2009 - Elsevier
Adaptive optimization (AO) schemes based on stochastic approximation principles such as
the Random Directions Kiefer–Wolfowitz (RDKW), the Simultaneous Perturbation Stochastic …

Large scale nonlinear control system fine-tuning through learning

EB Kosmatopoulos, A Kouvelas - IEEE Transactions on Neural …, 2009 - ieeexplore.ieee.org
Despite the continuous advances in the fields of intelligent control and computing, the
design and deployment of efficient large scale nonlinear control systems (LNCSs) requires a …

Adaptive performance optimization for large-scale traffic control systems

A Kouvelas, K Aboudolas… - IEEE Transactions …, 2011 - ieeexplore.ieee.org
In this paper, we study the problem of optimizing (fine-tuning) the design parameters of large-
scale traffic control systems that are composed of distinct and mutually interacting modules …