A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y **ao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

Weight-sharing neural architecture search: A battle to shrink the optimization gap

L **e, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Pc-darts: Partial channel connections for memory-efficient architecture search

Y Xu, L **e, X Zhang, X Chen, GJ Qi, Q Tian… - arxiv preprint arxiv …, 2019 - arxiv.org
Differentiable architecture search (DARTS) provided a fast solution in finding effective
network architectures, but suffered from large memory and computing overheads in jointly …

Investigating bi-level optimization for learning and vision from a unified perspective: A survey and beyond

R Liu, J Gao, J Zhang, D Meng… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Bi-Level Optimization (BLO) is originated from the area of economic game theory and then
introduced into the optimization community. BLO is able to handle problems with a …

A survey on neural architecture search

M Wistuba, A Rawat, T Pedapati - arxiv preprint arxiv:1905.01392, 2019 - arxiv.org
The growing interest in both the automation of machine learning and deep learning has
inevitably led to the development of a wide variety of automated methods for neural …

Differentiable quantum architecture search

SX Zhang, CY Hsieh, S Zhang… - Quantum Science and …, 2022 - iopscience.iop.org
Quantum architecture search (QAS) is the process of automating architecture engineering of
quantum circuits. It has been desired to construct a powerful and general QAS platform …

idarts: Differentiable architecture search with stochastic implicit gradients

M Zhang, SW Su, S Pan, X Chang… - International …, 2021 - proceedings.mlr.press
Abstract Differentiable ARchiTecture Search (DARTS) has recently become the mainstream
in the neural architecture search (NAS) due to its efficiency and simplicity. With a gradient …

Xnas: Neural architecture search with expert advice

N Nayman, A Noy, T Ridnik… - Advances in neural …, 2019 - proceedings.neurips.cc
This paper introduces a novel optimization method for differential neural architecture search,
based on the theory of prediction with expert advice. Its optimization criterion is well fitted for …

Neural predictor based quantum architecture search

SX Zhang, CY Hsieh, S Zhang… - … Learning: Science and …, 2021 - iopscience.iop.org
Variational quantum algorithms (VQAs) are widely speculated to deliver quantum
advantages for practical problems under the quantum–classical hybrid computational …

Overcoming multi-model forgetting in one-shot NAS with diversity maximization

M Zhang, H Li, S Pan, X Chang… - Proceedings of the ieee …, 2020 - openaccess.thecvf.com
Abstract One-Shot Neural Architecture Search (NAS) significantly improves the
computational efficiency through weight sharing. However, this approach also introduces …