Eight years of AutoML: categorisation, review and trends

R Barbudo, S Ventura, JR Romero - Knowledge and Information Systems, 2023 - Springer
Abstract Knowledge extraction through machine learning techniques has been successfully
applied in a large number of application domains. However, apart from the required …

Towards theoretically inspired neural initialization optimization

Y Yang, H Wang, H Yuan, Z Lin - Advances in Neural …, 2022 - proceedings.neurips.cc
Automated machine learning has been widely explored to reduce human efforts in
designing neural architectures and looking for proper hyperparameters. In the domain of …

Gradsign: Model performance inference with theoretical insights

Z Zhang, Z Jia - arxiv preprint arxiv:2110.08616, 2021 - arxiv.org
A key challenge in neural architecture search (NAS) is quickly inferring the predictive
performance of a broad spectrum of networks to discover statistically accurate and …

SIRIUS: Harvesting Whole-Program Optimization Opportunities for DNNs

Y Li, J Zhao, S Qianqi, H Mai, L Chen… - Proceedings of …, 2023 - proceedings.mlsys.org
As emerging applications are rapidly moving to accelerators, a greatdeal of research has
been proposed to improve the performance of the accelerators. For the AI applications …

Magis: Memory optimization via coordinated graph transformation and scheduling for dnn

R Chen, Z Ding, S Zheng, C Zhang, J Leng… - Proceedings of the 29th …, 2024 - dl.acm.org
Recently, memory consumption of Deep Neural Network (DNN) rapidly increases, mainly
due to long lifetimes and large shapes of tensors. Graph scheduling has emerged as an …

Neural architecture search using property guided synthesis

C **, PM Phothilimthana, S Roy - Proceedings of the ACM on …, 2022 - dl.acm.org
Neural architecture search (NAS) has become an increasingly important tool within the deep
learning community in recent years, yielding many practical advancements in the design of …

Canvas: End-to-End Kernel Architecture Search in Neural Networks

C Zhao, G Zhang, M Gao - arxiv preprint arxiv:2304.07741, 2023 - arxiv.org
The demands for higher performance and accuracy in neural networks (NNs) never end.
Existing tensor compilation and Neural Architecture Search (NAS) techniques orthogonally …

Syno: Structured Synthesis for Neural Operators

Y Zhuo, Z Su, C Zhao, M Gao - arxiv preprint arxiv:2410.23745, 2024 - arxiv.org
The desires for better prediction accuracy and higher execution performance in neural
networks never end. Neural architecture search (NAS) and tensor compilers are two popular …

Compiler-Based Memory Encryption for Machine Learning on Commodity Low-Power Devices

K Maeng, B Lucia - Proceedings of the 33rd ACM SIGPLAN International …, 2024 - dl.acm.org
Running machine learning (ML) on low-power IoT devices exposes unique security
concerns. Attackers can easily steal or manipulate sensitive user data or proprietary ML …

Combining Neural Architecture Search and Automatic Code Optimization: A Survey

I Bachiri, H Benmeziane, S Niar, R Baghdadi… - arxiv preprint arxiv …, 2024 - arxiv.org
Deep Learning models have experienced exponential growth in complexity and resource
demands in recent years. Accelerating these models for efficient execution on resource …