A comprehensive survey of neural architecture search: Challenges and solutions
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …
automatic representation capabilities. It has been proven that neural architecture design is …
Weight-sharing neural architecture search: A battle to shrink the optimization gap
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …
individual search methods have been replaced by weight-sharing search methods for higher …
Pc-darts: Partial channel connections for memory-efficient architecture search
Differentiable architecture search (DARTS) provided a fast solution in finding effective
network architectures, but suffered from large memory and computing overheads in jointly …
network architectures, but suffered from large memory and computing overheads in jointly …
Investigating bi-level optimization for learning and vision from a unified perspective: A survey and beyond
Bi-Level Optimization (BLO) is originated from the area of economic game theory and then
introduced into the optimization community. BLO is able to handle problems with a …
introduced into the optimization community. BLO is able to handle problems with a …
A survey on neural architecture search
The growing interest in both the automation of machine learning and deep learning has
inevitably led to the development of a wide variety of automated methods for neural …
inevitably led to the development of a wide variety of automated methods for neural …
Differentiable quantum architecture search
Quantum architecture search (QAS) is the process of automating architecture engineering of
quantum circuits. It has been desired to construct a powerful and general QAS platform …
quantum circuits. It has been desired to construct a powerful and general QAS platform …
idarts: Differentiable architecture search with stochastic implicit gradients
Abstract Differentiable ARchiTecture Search (DARTS) has recently become the mainstream
in the neural architecture search (NAS) due to its efficiency and simplicity. With a gradient …
in the neural architecture search (NAS) due to its efficiency and simplicity. With a gradient …
Xnas: Neural architecture search with expert advice
This paper introduces a novel optimization method for differential neural architecture search,
based on the theory of prediction with expert advice. Its optimization criterion is well fitted for …
based on the theory of prediction with expert advice. Its optimization criterion is well fitted for …
Neural predictor based quantum architecture search
Variational quantum algorithms (VQAs) are widely speculated to deliver quantum
advantages for practical problems under the quantum–classical hybrid computational …
advantages for practical problems under the quantum–classical hybrid computational …
Overcoming multi-model forgetting in one-shot NAS with diversity maximization
Abstract One-Shot Neural Architecture Search (NAS) significantly improves the
computational efficiency through weight sharing. However, this approach also introduces …
computational efficiency through weight sharing. However, this approach also introduces …