Recent advances in stochastic gradient descent in deep learning

Y Tian, Y Zhang, H Zhang - Mathematics, 2023 - mdpi.com
In the age of artificial intelligence, the best approach to handling huge amounts of data is a
tremendously motivating and hard problem. Among machine learning models, stochastic …

An overview of stochastic quasi-Newton methods for large-scale machine learning

TD Guo, Y Liu, CY Han - Journal of the Operations Research Society of …, 2023 - Springer
Numerous intriguing optimization problems arise as a result of the advancement of machine
learning. The stochastic first-order method is the predominant choice for those problems due …

Generalized maximum entropy based identification of graphical ARMA models

J You, C Yu, J Sun, J Chen - Automatica, 2022 - Elsevier
This paper focuses on the joint estimation of parameters and topologies of multivariate
graphical autoregressive moving-average (ARMA) processes. Since the graphical structure …

Self-organizing radial basis function neural network using accelerated second-order learning algorithm

HG Han, ML Ma, HY Yang, JF Qiao - Neurocomputing, 2022 - Elsevier
Gradient-based algorithms are commonly used for training radial basis function neural
network (RBFNN). However, it is still difficult to avoid vanishing gradient to improve the …

Microscopic mechanism of enhancing shale oil recovery through CO2 flooding-insights from molecular dynamics simulations

F Liu, X Gao, J Du, L Lin, D Hou, J Luo… - Journal of Molecular …, 2024 - Elsevier
Shale oil reserves are abundant worldwide and are a primary focus for future oil and gas
development. Shale reservoirs are dense, highly heterogeneous, and have a low oil …

Adaptive Stochastic Gradient Descent (SGD) for erratic datasets

I Dagal, K Tanriöven, A Nayir, B Akın - Future Generation Computer …, 2025 - Elsevier
Abstract Stochastic Gradient Descent (SGD) is a highly efficient optimization algorithm,
particularly well suited for large datasets due to its incremental parameter updates. In this …

Variance-reduced stochastic quasi-newton methods for decentralized learning

J Zhang, H Liu, AMC So, Q Ling - IEEE Transactions on Signal …, 2023 - ieeexplore.ieee.org
In this work, we investigate stochastic quasi-Newton methods for minimizing a finite sum of
cost functions over a decentralized network. We first develop a general algorithmic …

3D integral imaging depth estimation of partially occluded objects using mutual information and Bayesian optimization

P Wani, B Javidi - Optics Express, 2023 - opg.optica.org
Integral imaging (InIm) is useful for passive ranging and 3D visualization of partially-
occluded objects. We consider 3D object localization within a scene and in occlusions. 2D …

Offline Data-Driven Optimization at Scale: A Cooperative Coevolutionary Approach

YJ Gong, YT Zhong, HG Huang - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Data-driven evolutionary algorithms (DDEAs) have received increasing attention during the
past decade, but most existing studies are dedicated to solving relatively small-scale …

[HTML][HTML] A modern data-mining approach based on genetically optimized fuzzy systems for interpretable and accurate smart-grid stability prediction

MB Gorzałczany, J Piekoszewski, F Rudziński - Energies, 2020 - mdpi.com
The main objective and contribution of this paper was/is the application of our knowledge-
based data-mining approach (a fuzzy rule-based classification system) characterized by a …