Application of meta-heuristic algorithms for training neural networks and deep learning architectures: A comprehensive review

M Kaveh, MS Mesgari - Neural Processing Letters, 2023 - Springer
The learning process and hyper-parameter optimization of artificial neural networks (ANNs)
and deep learning (DL) architectures is considered one of the most challenging machine …

Evolutionary algorithms and their applications to engineering problems

A Slowik, H Kwasnicka - Neural Computing and Applications, 2020 - Springer
The main focus of this paper is on the family of evolutionary algorithms and their real-life
applications. We present the following algorithms: genetic algorithms, genetic programming …

Metaheuristic design of feedforward neural networks: A review of two decades of research

VK Ojha, A Abraham, V Snášel - Engineering Applications of Artificial …, 2017 - Elsevier
Over the past two decades, the feedforward neural network (FNN) optimization has been a
key interest among the researchers and practitioners of multiple disciplines. The FNN …

Partial connection based on channel attention for differentiable neural architecture search

Y Xue, J Qin - IEEE Transactions on Industrial Informatics, 2022 - ieeexplore.ieee.org
Differentiable neural architecture search (DARTS), as a gradient-guided search method,
greatly reduces the cost of computation and speeds up the search. In DARTS, the …

Selection of proper neural network sizes and architectures—A comparative study

D Hunter, H Yu, MS Pukish III, J Kolbusz… - IEEE Transactions …, 2012 - ieeexplore.ieee.org
One of the major difficulties facing researchers using neural networks is the selection of the
proper size and topology of the networks. The problem is even more complex because often …

Estimation of battery state of health using probabilistic neural network

HT Lin, TJ Liang, SM Chen - IEEE transactions on industrial …, 2012 - ieeexplore.ieee.org
In this study, a probabilistic neural network (PNN) is used to estimate the state of health
(SOH) of Li-ion batteries. The accurate prediction of SOH can help avoid inconveniences or …

Discrete differential evolution algorithm for distributed blocking flowshop scheduling with makespan criterion

G Zhang, K **ng, F Cao - Engineering Applications of Artificial Intelligence, 2018 - Elsevier
This paper deals with a distributed blocking flowshop scheduling problem, which tries to
solve the blocking flowshop scheduling in distributed manufacturing environment. The …

An improved self-adaptive differential evolution algorithm for optimization problems

SM Elsayed, RA Sarker… - IEEE Transactions on …, 2012 - ieeexplore.ieee.org
Many real-world optimization problems are difficult to solve as they do not possess the nice
mathematical properties required by the exact algorithms. Evolutionary algorithms are …

A benchmark of recent population-based metaheuristic algorithms for multi-layer neural network training

SJ Mousavirad, G Schaefer, SMJ Jalali… - Proceedings of the 2020 …, 2020 - dl.acm.org
Multi-layer neural networks (MLNNs) are extensively used in many industrial applications.
Training is the crucial task for MLNNs. While gradient descent-based approaches are most …

A novel adaptive feed-forward-PID controller of a SCARA parallel robot using pneumatic artificial muscle actuator based on neural network and modified differential …

NN Son, C Van Kien, HPH Anh - Robotics and Autonomous Systems, 2017 - Elsevier
This paper proposes a novel control system combining adaptively feed-forward neural
controller and PID controller to control the joint-angle position of the SCARA parallel robot …