Normalization techniques in training dnns: Methodology, analysis and application

L Huang, J Qin, Y Zhou, F Zhu, L Liu… - IEEE transactions on …, 2023 - ieeexplore.ieee.org
Normalization techniques are essential for accelerating the training and improving the
generalization of deep neural networks (DNNs), and have successfully been used in various …

Methods for pruning deep neural networks

S Vadera, S Ameen - IEEE Access, 2022 - ieeexplore.ieee.org
This paper presents a survey of methods for pruning deep neural networks. It begins by
categorising over 150 studies based on the underlying approach used and then focuses on …

TinyLSTMs: Efficient neural speech enhancement for hearing aids

I Fedorov, M Stamenovic, C Jensen, LC Yang… - arxiv preprint arxiv …, 2020 - arxiv.org
Modern speech enhancement algorithms achieve remarkable noise suppression by means
of large recurrent neural networks (RNNs). However, large RNNs limit practical deployment …

An intelligent early warning system for harmful algal blooms: harnessing the power of big data and deep learning

J Qian, L Qian, N Pu, Y Bi, A Wilhelms… - … science & technology, 2024 - ACS Publications
Harmful algal blooms (HABs) pose a significant ecological threat and economic detriment to
freshwater environments. In order to develop an intelligent early warning system for HABs …

Effective convolutional attention network for multi-label clinical document classification

Y Liu, H Cheng, R Klopfer, MR Gormley… - Proceedings of the …, 2021 - aclanthology.org
Multi-label document classification (MLDC) problems can be challenging, especially for long
documents with a large label set and a long-tail distribution over labels. In this paper, we …

Powernorm: Rethinking batch normalization in transformers

S Shen, Z Yao, A Gholami… - … on machine learning, 2020 - proceedings.mlr.press
The standard normalization method for neural network (NN) models used in Natural
Language Processing (NLP) is layer normalization (LN). This is different than batch …

Stock price forecasting using PSO hypertuned neural nets and ensembling

A Chauhan, SJ Shivaprakash, H Sabireen, AQ Md… - Applied Soft …, 2023 - Elsevier
The stock market is a platform that allows individuals and organizations to buy stocks of
publicly listed companies. It is imperative for investors and traders to utilize the platform to …

Cpt: Efficient deep neural network training via cyclic precision

Y Fu, H Guo, M Li, X Yang, Y Ding, V Chandra… - arxiv preprint arxiv …, 2021 - arxiv.org
Low-precision deep neural network (DNN) training has gained tremendous attention as
reducing precision is one of the most effective knobs for boosting DNNs' training time/energy …

Audio tampering forensics based on representation learning of enf phase sequence

C Zeng, Y Yang, Z Wang, S Kong… - International Journal of …, 2022 - igi-global.com
This paper proposes an audio tampering detection method based on the ENF phase and BI-
LSTM network from the perspective of temporal feature representation learning. First, the …

Automated hearing loss type classification based on pure tone audiometry data

M Kassjański, M Kulawiak, T Przewoźny… - Scientific Reports, 2024 - nature.com
Hearing problems are commonly diagnosed with the use of tonal audiometry, which
measures a patient's hearing threshold in both air and bone conduction at various …