Model compression and hardware acceleration for neural networks: A comprehensive survey

L Deng, G Li, S Han, L Shi, Y **e - Proceedings of the IEEE, 2020 - ieeexplore.ieee.org
Domain-specific hardware is becoming a promising topic in the backdrop of improvement
slow down for general-purpose processors due to the foreseeable end of Moore's Law …

Artificial neural networks for photonic applications—from algorithms to implementation: tutorial

P Freire, E Manuylovich, JE Prilepsky… - Advances in Optics and …, 2023 - opg.optica.org
This tutorial–review on applications of artificial neural networks in photonics targets a broad
audience, ranging from optical research and engineering communities to computer science …

Deblurgan-v2: Deblurring (orders-of-magnitude) faster and better

O Kupyn, T Martyniuk, J Wu… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
We present a new end-to-end generative adversarial network (GAN) for single image motion
deblurring, named DeblurGAN-V2, which considerably boosts state-of-the-art deblurring …

The lottery ticket hypothesis for pre-trained bert networks

T Chen, J Frankle, S Chang, S Liu… - Advances in neural …, 2020 - proceedings.neurips.cc
In natural language processing (NLP), enormous pre-trained models like BERT have
become the standard starting point for training on a range of downstream tasks, and similar …

Drawing early-bird tickets: Towards more efficient training of deep networks

H You, C Li, P Xu, Y Fu, Y Wang, X Chen… - arxiv preprint arxiv …, 2019 - arxiv.org
(Frankle & Carbin, 2019) shows that there exist winning tickets (small but critical
subnetworks) for dense, randomly initialized networks, that can be trained alone to achieve …

Computational complexity optimization of neural network-based equalizers in digital signal processing: a comprehensive approach

P Freire, S Srivallapanondh, B Spinnler… - Journal of Lightwave …, 2024 - ieeexplore.ieee.org
Experimental results based on offline processing reported at optical conferences
increasingly rely on neural network-based equalizers for accurate data recovery. However …

Hw-nas-bench: Hardware-aware neural architecture search benchmark

C Li, Z Yu, Y Fu, Y Zhang, Y Zhao, H You, Q Yu… - arxiv preprint arxiv …, 2021 - arxiv.org
HardWare-aware Neural Architecture Search (HW-NAS) has recently gained tremendous
attention by automating the design of DNNs deployed in more resource-constrained daily …

Computational complexity evaluation of neural network applications in signal processing

P Freire, S Srivallapanondh, A Napoli… - arxiv preprint arxiv …, 2022 - arxiv.org
In this paper, we provide a systematic approach for assessing and comparing the
computational complexity of neural network layers in digital signal processing. We provide …

Exploiting kernel sparsity and entropy for interpretable CNN compression

Y Li, S Lin, B Zhang, J Liu… - Proceedings of the …, 2019 - openaccess.thecvf.com
Compressing convolutional neural networks (CNNs) has received ever-increasing research
focus. However, most existing CNN compression methods do not interpret their inherent …

Model compression with adversarial robustness: A unified optimization framework

S Gui, H Wang, H Yang, C Yu… - Advances in Neural …, 2019 - proceedings.neurips.cc
Deep model compression has been extensively studied, and state-of-the-art methods can
now achieve high compression ratios with minimal accuracy loss. This paper studies model …