A survey on compiler autotuning using machine learning

AH Ashouri, W Killian, J Cavazos, G Palermo… - ACM Computing …, 2018 - dl.acm.org
Since the mid-1990s, researchers have been trying to use machine-learning-based
approaches to solve a number of different compiler optimization problems. These …

Full stack optimization of transformer inference: a survey

S Kim, C Hooper, T Wattanawong, M Kang… - arxiv preprint arxiv …, 2023 - arxiv.org
Recent advances in state-of-the-art DNN architecture design have been moving toward
Transformer models. These models achieve superior accuracy across a wide range of …

Opentuner: An extensible framework for program autotuning

J Ansel, S Kamil, K Veeramachaneni… - Proceedings of the 23rd …, 2014 - dl.acm.org
Program autotuning has been shown to achieve better or more portable performance in a
number of domains. However, autotuners themselves are rarely portable between projects …

Cosa: Scheduling by constrained optimization for spatial accelerators

Q Huang, M Kang, G Dinh, T Norell… - 2021 ACM/IEEE 48th …, 2021 - ieeexplore.ieee.org
Recent advances in Deep Neural Networks (DNNs) have led to active development of
specialized DNN accelerators, many of which feature a large number of processing …

Machine learning in compiler optimization

Z Wang, M O'Boyle - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
In the last decade, machine-learning-based compilation has moved from an obscure
research niche to a mainstream activity. In this paper, we describe the relationship between …

Language models for code optimization: Survey, challenges and future directions

J Gong, V Voskanyan, P Brookes, F Wu, W Jie… - arxiv preprint arxiv …, 2025 - arxiv.org
Language models (LMs) built upon deep neural networks (DNNs) have recently
demonstrated breakthrough effectiveness in software engineering tasks like code …

Bridging the gap between deep learning and sparse matrix format selection

Y Zhao, J Li, C Liao, X Shen - Proceedings of the 23rd ACM SIGPLAN …, 2018 - dl.acm.org
This work presents a systematic exploration on the promise and special challenges of deep
learning for sparse matrix format selection---a problem of determining the best storage …

Efficient compiler autotuning via bayesian optimization

J Chen, N Xu, P Chen, H Zhang - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
A typical compiler such as GCC supports hundreds of optimizations controlled by
compilation flags for improving the runtime performance of the compiled program. Due to the …

Micomp: Mitigating the compiler phase-ordering problem using optimization sub-sequences and machine learning

AH Ashouri, A Bignoli, G Palermo, C Silvano… - ACM Transactions on …, 2017 - dl.acm.org
Recent compilers offer a vast number of multilayered optimizations targeting different code
segments of an application. Choosing among these optimizations can significantly impact …

Autotuning algorithmic choice for input sensitivity

Y Ding, J Ansel, K Veeramachaneni, X Shen… - ACM SIGPLAN …, 2015 - dl.acm.org
A daunting challenge faced by program performance autotuning is input sensitivity, where
the best autotuned configuration may vary with different input sets. This paper presents a …