A review of convolutional neural network architectures and their optimizations

S Cong, Y Zhou - Artificial Intelligence Review, 2023 - Springer
The research advances concerning the typical architectures of convolutional neural
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …

From federated learning to federated neural architecture search: a survey

H Zhu, H Zhang, Y ** - Complex & Intelligent Systems, 2021 - Springer
Federated learning is a recently proposed distributed machine learning paradigm for privacy
preservation, which has found a wide range of applications where data privacy is of primary …

Single path one-shot neural architecture search with uniform sampling

Z Guo, X Zhang, H Mu, W Heng, Z Liu, Y Wei… - Computer Vision–ECCV …, 2020 - Springer
We revisit the one-shot Neural Architecture Search (NAS) paradigm and analyze its
advantages over existing NAS approaches. Existing one-shot method, however, is hard to …

Adversarial autoaugment

X Zhang, Q Wang, J Zhang, Z Zhong - arxiv preprint arxiv:1912.11188, 2019 - arxiv.org
Data augmentation (DA) has been widely utilized to improve generalization in training deep
neural networks. Recently, human-designed data augmentation has been gradually …

Neural architecture search based on a multi-objective evolutionary algorithm with probability stack

Y Xue, C Chen, A Słowik - IEEE Transactions on Evolutionary …, 2023 - ieeexplore.ieee.org
With the emergence of deep neural networks, many research fields, such as image
classification, object detection, speech recognition, natural language processing, machine …

Milenas: Efficient neural architecture search via mixed-level reformulation

C He, H Ye, L Shen, T Zhang - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
Many recently proposed methods for Neural Architecture Search (NAS) can be formulated
as bilevel optimization. For efficient implementation, its solution requires approximations of …

Autobalance: Optimized loss functions for imbalanced data

M Li, X Zhang, C Thrampoulidis… - Advances in Neural …, 2021 - proceedings.neurips.cc
Imbalanced datasets are commonplace in modern machine learning problems. The
presence of under-represented classes or groups with sensitive attributes results in …

Weight-sharing neural architecture search: A battle to shrink the optimization gap

L **e, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Particle swarm optimization for compact neural architecture search for image classification

J Huang, B Xue, Y Sun, M Zhang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Convolutional neural networks (CNNs) are a superb computing paradigm in deep learning,
and their architectures are considered to be the key to performance breakthroughs in …

Efficient evolutionary search of attention convolutional networks via sampled training and node inheritance

H Zhang, Y **, R Cheng, K Hao - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
The performance of deep neural networks is heavily dependent on its architecture and
various neural architecture search strategies have been developed for automated network …