Activation functions in deep learning: A comprehensive survey and benchmark

SR Dubey, SK Singh, BB Chaudhuri - Neurocomputing, 2022 - Elsevier
Neural networks have shown tremendous growth in recent years to solve numerous
problems. Various types of neural networks have been introduced to deal with different types …

A survey on modern trainable activation functions

A Apicella, F Donnarumma, F Isgrò, R Prevete - Neural Networks, 2021 - Elsevier
In neural networks literature, there is a strong interest in identifying and defining activation
functions which can improve neural network performance. In recent years there has been a …

Complex-valued neural networks: A comprehensive survey

CY Lee, H Hasegawa, S Gao - IEEE/CAA Journal of …, 2022 - ieeexplore.ieee.org
Complex-valued neural networks (CVNNs) have shown their excellent efficiency compared
to their real counter-parts in speech enhancement, image and signal processing …

CINENet: deep learning-based 3D cardiac CINE MRI reconstruction with multi-coil complex-valued 4D spatio-temporal convolutions

T Küstner, N Fuin, K Hammernik, A Bustin, H Qi… - Scientific reports, 2020 - nature.com
Cardiac CINE magnetic resonance imaging is the gold-standard for the assessment of
cardiac function. Imaging accelerations have shown to enable 3D CINE with left ventricular …

How important are activation functions in regression and classification? A survey, performance comparison, and future directions

AD Jagtap, GE Karniadakis - Journal of Machine Learning for …, 2023 - dl.begellhouse.com
Inspired by biological neurons, the activation functions play an essential part in the learning
process of any artificial neural network (ANN) commonly used in many real-world problems …

A survey of complex-valued neural networks

J Bassey, L Qian, X Li - ar** Deep Convolutional Neural Networks (DCNNs) for image classification
is a complicated task that needs considerable effort and knowledge. By employing an …