Compacting deep neural networks for Internet of Things: Methods and applications

K Zhang, H Ying, HN Dai, L Li, Y Peng… - IEEE Internet of …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have shown great success in completing complex tasks.
However, DNNs inevitably bring high computational cost and storage consumption due to …

Cpt: Efficient deep neural network training via cyclic precision

Y Fu, H Guo, M Li, X Yang, Y Ding, V Chandra… - arxiv preprint arxiv …, 2021 - arxiv.org
Low-precision deep neural network (DNN) training has gained tremendous attention as
reducing precision is one of the most effective knobs for boosting DNNs' training time/energy …

An efficient and scalable collection of fly-inspired voting units for visual place recognition in changing environments

B Arcanjo, B Ferrarini, M Milford… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
State-of-the-art visual place recognition performance is currently being achieved utilizing
deep learning based approaches. Despite the recent efforts in designing lightweight …

Better schedules for low precision training of deep neural networks

CR Wolfe, A Kyrillidis - Machine Learning, 2024 - Springer
Low precision training can significantly reduce the computational overhead of training deep
neural networks (DNNs). Though many such techniques exist, cyclic precision training …

Position-aware lightweight object detectors with depthwise separable convolutions

L Chang, S Zhang, H Du, Z You, S Wang - Journal of Real-Time Image …, 2021 - Springer
Recently, significant improvements have been achieved for object detection algorithm by
increasing the size of convolutional neural network (CNN) models, but the resulting increase …

Contrastive quant: quantization makes stronger contrastive learning

Y Fu, Q Yu, M Li, X Ouyang, V Chandra… - Proceedings of the 59th …, 2022 - dl.acm.org
Contrastive learning learns visual representations by enforcing feature consistency under
different augmented views. In this work, we explore contrastive learning from a new …

Exploring the Creation and Humanization of Digital Life: Consciousness Simulation and Human-Machine Interaction

Q Zhang - arxiv preprint arxiv:2310.13710, 2023 - arxiv.org
Digital life, a form of life generated by computer programs or artificial intelligence systems, it
possesses self-awareness, thinking abilities, emotions, and subjective consciousness …

Efficient visual place recognition in changing environments for resource-constrained platforms

BR Queirós Arcanjo - 2025 - repository.essex.ac.uk
Visual Place Recognition (VPR) enables autonomous systems to localize themselves within
their environment using image information, a crucial component of robotic navigation. The …

Theories and Perspectives on Practical Deep Learning

CR Wolfe - 2023 - search.proquest.com
Deep neural networks (DNNs) have proven to be adept at accurately automating many tasks
(eg, image and text classification, object detection, text generation, and more). Across most …

Mixed precision training of an artificial neural network

H Zhu, NA Taesik, D Lo, ES Chung - US Patent App. 16/357,139, 2020 - Google Patents
The use of mixed precision values when training an artificial neural network (ANN) can
increase performance while reducing cost. Certain portions and/or steps of an ANN may be …