Bounded activation functions for enhanced training stability of deep neural networks on visual pattern recognition problems

SS Liew, M Khalil-Hani, R Bakhteri - Neurocomputing, 2016 - Elsevier
This paper focuses on the enhancement of the generalization ability and training stability of
deep neural networks (DNNs). New activation functions that we call bounded rectified linear …

Object-oriented method combined with deep convolutional neural networks for land-use-type classification of remote sensing images

B **, P Ye, X Zhang, W Song, S Li - Journal of the Indian Society of …, 2019 - Springer
Land-use information provides a direct representation of the effect of human activities on the
environment, and an accurate and efficient land-use classification of remote sensing images …

Evaluation of maxout activations in deep learning across several big data domains

G Castaneda, P Morris, TM Khoshgoftaar - Journal of Big Data, 2019 - Springer
This study investigates the effectiveness of multiple maxout activation function variants on 18
datasets using Convolutional Neural Networks. A network with maxout activation has a …

Evolutionary multi-task learning for modular knowledge representation in neural networks

R Chandra, A Gupta, YS Ong, CK Goh - Neural Processing Letters, 2018 - Springer
The brain can be viewed as a complex modular structure with features of information
processing through knowledge storage and retrieval. Modularity ensures that the knowledge …

Reconfigurable FPGA implementation of neural networks

Z Hajduk - Neurocomputing, 2018 - Elsevier
This brief paper presents two implementations of feed-forward artificial neural networks in
FPGAs. The implementations differ in the FPGA resources requirement and calculations …

Generic model implementation of deep neural network activation functions using GWO-optimized SCPWL model on FPGA

HMH Al-Rikabi, MAM Al-Ja'afari, AH Ali… - Microprocessors and …, 2020 - Elsevier
The implementation of non-linear Activation Functions (AFs) within the Artificial Neural
Network (ANN) on the Field Programmable Gate Array (FPGA) is substantial due to the …

FPGA implementation of two multilayer perceptron neural network in cascade for efficient real time hand gestures tracking

M Heidaryan - Microprocessors and Microsystems, 2023 - Elsevier
This paper presents implementation of a hand gestures tracking system with a fully
connected multilayer perceptron and a supervised sequential learning algorithm on low cost …

NACU: A non-linear arithmetic unit for neural networks

G Baccelli, D Stathis, A Hemani… - 2020 57th ACM/IEEE …, 2020 - ieeexplore.ieee.org
Reconfigurable architectures targeting neural networks are an attractive option. They allow
multiple neural networks of different types to be hosted on the same hardware, in parallel or …

Maxout neural network for big data medical fraud detection

G Castaneda, P Morris… - 2019 IEEE Fifth …, 2019 - ieeexplore.ieee.org
Globally, health care losses due to fraud rise every year, and for this reason fraud detection
is an active research area that, in the US alone, can potentially save billions of dollars. We …

Optimization of structure and system latency in evolvable block-based neural networks using genetic algorithm

VP Nambiar, M Khalil-Hani, MN Marsono, CW Sia - Neurocomputing, 2014 - Elsevier
This paper proposes a novel optimization method that utilizes a multi-population parallel
genetic algorithm (GA) to simultaneously optimize the structure and system latency of …