Do we actually need dense over-parameterization? in-time over-parameterization in sparse training

S Liu, L Yin, DC Mocanu… - … on Machine Learning, 2021 - proceedings.mlr.press
In this paper, we introduce a new perspective on training deep neural networks capable of
state-of-the-art performance without the need for the expensive over-parameterization by …

A programmable heterogeneous microprocessor based on bit-scalable in-memory computing

H Jia, H Valavi, Y Tang, J Zhang… - IEEE Journal of Solid …, 2020 - ieeexplore.ieee.org
In-memory computing (IMC) addresses the cost of accessing data from memory in a manner
that introduces a tradeoff between energy/throughput and computation signal-to-noise ratio …

Compression of deep learning models for text: A survey

M Gupta, P Agrawal - ACM Transactions on Knowledge Discovery from …, 2022 - dl.acm.org
In recent years, the fields of natural language processing (NLP) and information retrieval (IR)
have made tremendous progress thanks to deep learning models like Recurrent Neural …

CovidDeep: SARS-CoV-2/COVID-19 test based on wearable medical sensors and efficient neural networks

S Hassantabar, N Stefano, V Ghanakota… - IEEE Transactions …, 2021 - ieeexplore.ieee.org
The novel coronavirus (SARS-CoV-2) has led to a pandemic. The current testing regime
based on Reverse Transcription-Polymerase Chain Reaction for SARS-CoV-2 has been …

Recurrent neural networks: An embedded computing perspective

NM Rezk, M Purnaprajna, T Nordström… - IEEE Access, 2020 - ieeexplore.ieee.org
Recurrent Neural Networks (RNNs) are a class of machine learning algorithms used for
applications with time-series and sequential data. Recently, there has been a strong interest …

Scalable and programmable neural network inference accelerator based on in-memory computing

H Jia, M Ozatay, Y Tang, H Valavi… - IEEE Journal of Solid …, 2021 - ieeexplore.ieee.org
This work demonstrates a programmable in-memory-computing (IMC) inference accelerator
for scalable execution of neural network (NN) models, leveraging a high-signal-to-noise …