Activation function plays an important role in neural network. Applying activation function in
network appropriately can improve accuracy and speed up converging. In this paper, we …