Large language models for compiler optimization

C Cummins, V Seeker, D Grubisic, M Elhoushi… - arxiv preprint arxiv …, 2023 - arxiv.org
We explore the novel application of Large Language Models to code optimization. We
present a 7B-parameter transformer model trained from scratch to optimize LLVM assembly …

Meta large language model compiler: Foundation models of compiler optimization

C Cummins, V Seeker, D Grubisic, B Roziere… - arxiv preprint arxiv …, 2024 - arxiv.org
Large Language Models (LLMs) have demonstrated remarkable capabilities across a
variety of software engineering and coding tasks. However, their application in the domain of …

Compiler generated feedback for large language models

D Grubisic, C Cummins, V Seeker… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce a novel paradigm in compiler optimization powered by Large Language
Models with compiler feedback to optimize the code size of LLVM assembly. The model …

Compile: A large ir dataset from production sources

A Grossman, L Paehler, K Parasyris, T Ben-Nun… - arxiv preprint arxiv …, 2023 - arxiv.org
Code is increasingly becoming a core data modality of modern machine learning research
impacting not only the way we write code with conversational agents like OpenAI's ChatGPT …

Llm-vectorizer: Llm-based verified loop vectorizer

J Taneja, A Laird, C Yan, M Musuvathi… - arxiv preprint arxiv …, 2024 - arxiv.org
Vectorization is a powerful optimization technique that significantly boosts the performance
of high performance computing applications operating on large data arrays. Despite …

Enhancing Performance through Control-Flow Unmerging and Loop Unrolling on GPUs

A Murtovi, G Georgakoudis, K Parasyris… - 2024 IEEE/ACM …, 2024 - ieeexplore.ieee.org
Compilers use a wide range of advanced optimizations to improve the quality of the machine
code they generate. In most cases, compiler optimizations rely on precise analyses to be …

LLM Compiler: Foundation Language Models for Compiler Optimization

C Cummins, V Seeker, D Grubisic, B Roziere… - Proceedings of the 34th …, 2025 - dl.acm.org
Large Language Models (LLMs) have demonstrated remarkable capabilities across a
variety of software engineering and coding tasks. However, their application in the domain of …

Path Planning using Reinforcement Learning: A Policy Iteration Approach

S Shivdikar, J Nirmal - arxiv preprint arxiv:2303.07535, 2023 - arxiv.org
With the impact of real-time processing being realized in the recent past, the need for
efficient implementations of reinforcement learning algorithms has been on the rise. Albeit …

Optimizing Machine Learning Operators and Models for Specific Hardware Using Apache-TVM

KT Madathil, A Dugar, N Patil… - 2023 14th …, 2023 - ieeexplore.ieee.org
Diligent utilization of hardware resources when dealing with computationally intensive jobs
like machine learning (ML) that have a huge scope of compiler optimizations are often …

ACPO: AI-Enabled Compiler-Driven Program Optimization

AH Ashouri, MA Manzoor, DM Vu, R Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
The key to performance optimization of a program is to decide correctly when a certain
transformation should be applied by a compiler. This is an ideal opportunity to apply …