A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y **ao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

Hyper-parameter optimization: A review of algorithms and applications

T Yu, H Zhu - arxiv preprint arxiv:2003.05689, 2020 - arxiv.org
Since deep neural networks were developed, they have made huge contributions to
everyday lives. Machine learning provides more rational advice than humans are capable of …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arxiv preprint arxiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Nas-bench-201: Extending the scope of reproducible neural architecture search

X Dong, Y Yang - arxiv preprint arxiv:2001.00326, 2020 - arxiv.org
Neural architecture search (NAS) has achieved breakthrough success in a great number of
applications in the past few years. It could be time to take a step back and analyze the good …

Automated machine learning: past, present and future

M Baratchi, C Wang, S Limmer, JN van Rijn… - Artificial intelligence …, 2024 - Springer
Automated machine learning (AutoML) is a young research area aiming at making high-
performance machine learning techniques accessible to a broad set of users. This is …

Searching for a robust neural architecture in four gpu hours

X Dong, Y Yang - Proceedings of the IEEE/CVF conference …, 2019 - openaccess.thecvf.com
Conventional neural architecture search (NAS) approaches are usually based on
reinforcement learning or evolutionary strategy, which take more than 1000 GPU hours to …

Neural architecture search: A survey

T Elsken, JH Metzen, F Hutter - Journal of Machine Learning Research, 2019 - jmlr.org
Deep Learning has enabled remarkable progress over the last years on a variety of tasks,
such as image recognition, speech recognition, and machine translation. One crucial aspect …

Darts: Differentiable architecture search

H Liu, K Simonyan, Y Yang - arxiv preprint arxiv:1806.09055, 2018 - arxiv.org
This paper addresses the scalability challenge of architecture search by formulating the task
in a differentiable manner. Unlike conventional approaches of applying evolution or …

SNAS: stochastic neural architecture search

S **e, H Zheng, C Liu, L Lin - arxiv preprint arxiv:1812.09926, 2018 - arxiv.org
We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end
solution to Neural Architecture Search (NAS) that trains neural operation parameters and …

Efficient neural architecture search via parameters sharing

H Pham, M Guan, B Zoph, Q Le… - … conference on machine …, 2018 - proceedings.mlr.press
Abstract We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive
approach for automatic model design. ENAS constructs a large computational graph, where …