A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y **ao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

A comprehensive survey on hardware-aware neural architecture search

H Benmeziane, KE Maghraoui, H Ouarnoughi… - arxiv preprint arxiv …, 2021 - arxiv.org
Neural Architecture Search (NAS) methods have been growing in popularity. These
techniques have been fundamental to automate and speed up the time consuming and error …

AutoML: A survey of the state-of-the-art

X He, K Zhao, X Chu - Knowledge-based systems, 2021 - Elsevier
Deep learning (DL) techniques have obtained remarkable achievements on various tasks,
such as image recognition, object detection, and language modeling. However, building a …

Neural architecture search without training

J Mellor, J Turner, A Storkey… - … conference on machine …, 2021 - proceedings.mlr.press
The time and effort involved in hand-designing deep neural networks is immense. This has
prompted the development of Neural Architecture Search (NAS) techniques to automate this …

SNAS: stochastic neural architecture search

S **e, H Zheng, C Liu, L Lin - arxiv preprint arxiv:1812.09926, 2018 - arxiv.org
We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end
solution to Neural Architecture Search (NAS) that trains neural operation parameters and …

Efficient neural architecture search via parameters sharing

H Pham, M Guan, B Zoph, Q Le… - … conference on machine …, 2018 - proceedings.mlr.press
Abstract We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive
approach for automatic model design. ENAS constructs a large computational graph, where …

Neural architecture optimization

R Luo, F Tian, T Qin, E Chen… - Advances in neural …, 2018 - proceedings.neurips.cc
Automatic neural architecture design has shown its potential in discovering powerful neural
network architectures. Existing methods, no matter based on reinforcement learning or …

[PDF][PDF] Taking human out of learning applications: A survey on automated machine learning

Q Yao, M Wang, Y Chen, W Dai, YF Li… - arxiv preprint arxiv …, 2018 - academia.edu
Machine learning techniques have deeply rooted in our everyday life. However, since it is
knowledge-and labor-intensive to pursue good learning performance, humans are heavily …

Bananas: Bayesian optimization with neural architectures for neural architecture search

C White, W Neiswanger, Y Savani - … of the AAAI conference on artificial …, 2021 - ojs.aaai.org
Over the past half-decade, many methods have been considered for neural architecture
search (NAS). Bayesian optimization (BO), which has long had success in hyperparameter …

[PDF][PDF] Nas-bench-301 and the case for surrogate benchmarks for neural architecture search

J Siems, L Zimmer, A Zela, J Lukasik… - arxiv preprint arxiv …, 2020 - researchgate.net
ABSTRACT Neural Architecture Search (NAS) is a logical next step in the automatic learning
of representations, but the development of NAS methods is slowed by high computational …