Three decades of activations: A comprehensive survey of 400 activation functions for neural networks

V Kunc, J Kléma - arxiv preprint arxiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …

Fractional ordering of activation functions for neural networks: A case study on Texas wind turbine

B Ramadevi, VR Kasi, K Bingi - Engineering Applications of Artificial …, 2024 - Elsevier
Activation functions play an important role in deep learning models by introducing non-
linearity to the output of a neuron, enabling the network to learn complex patterns and non …

A radiant shift: Attention-embedded CNNs for accurate solar irradiance forecasting and prediction from sky images

AL Jonathan, D Cai, CC Ukwuoma, NJJ Nkou… - Renewable Energy, 2024 - Elsevier
The continuous increase in solar power integration with energy systems can be attributed to
the push for cleaner energy use globally, highlighting the importance of accurate solar …

Hybrid LSTM-Based Fractional-Order Neural Network for Jeju Island's Wind Farm Power Forecasting

B Ramadevi, VR Kasi, K Bingi - Fractal and Fractional, 2024 - mdpi.com
Efficient integration of wind energy requires accurate wind power forecasting. This prediction
is critical in optimising grid operation, energy trading, and effectively harnessing renewable …

Recent advances and applications of fractional-order neural networks

M Maiti, M Sunder, R Abishek, K Bingi, NB Shaik… - Engineering …, 2022 - engj.org
This paper focuses on the growth, development, and future of various forms of fractional-
order neural networks. Multiple advances in structure, learning algorithms, and methods …

[HTML][HTML] Enhancing neural network classification using fractional-order activation functions

M Kumar, U Mehta, G Cirrincione - AI Open, 2024 - Elsevier
In this paper, a series of novel activation functions is presented, which is derived using the
improved Riemann–Liouville conformable fractional derivative (RL CFD). This study …

Enhancement of texas wind turbine power predictions using fractional order neural network by incorporating machine learning models to impute missing data

B Ramadevi, VR Kasi, K Bingi - Knowledge-Based Systems, 2024 - Elsevier
In real-world datasets, missed data is often expected due to sensor errors, environmental
conditions, communication errors, and other technical limitations. These factors can affect …

A conformable artificial neural network model to improve the void fraction prediction in helical heat exchangers

JA Hernández, JE Solís-Pérez, A Parrales… - … Communications in Heat …, 2023 - Elsevier
This study proposes a conformable artificial neural network model to improve the void
fraction prediction in helical heat exchangers. The obtained model had only one neuron in …

PolyLU: A simple and robust polynomial-based linear unit activation function for deep learning

HS Feng, CH Yang - IEEE Access, 2023 - ieeexplore.ieee.org
The activation function has a critical influence on whether a convolutional neural network in
deep learning can converge or not; a proper activation function not only makes the …

Enhancing the performance of CNN models for pneumonia and skin cancer detection using novel fractional activation function

M Kumar, U Mehta - Applied Soft Computing, 2025 - Elsevier
This paper introduces a novel Riemann–Liouville (RL) conformable fractional derivative
based Adaptable-Shifted-Fractional-Rectified-Linear-Unit, briefly called RL ASFReLU, and …