A survey on deep learning for software engineering

Y Yang, X **a, D Lo, J Grundy - ACM Computing Surveys (CSUR), 2022 - dl.acm.org
In 2006, Geoffrey Hinton proposed the concept of training “Deep Neural Networks (DNNs)”
and an improved model training method to break the bottleneck of neural network …

Mathematical discoveries from program search with large language models

B Romera-Paredes, M Barekatain, A Novikov, M Balog… - Nature, 2024 - nature.com
Large language models (LLMs) have demonstrated tremendous capabilities in solving
complex tasks, from quantitative reasoning to understanding natural language. However …

Faster sorting algorithms discovered using deep reinforcement learning

DJ Mankowitz, A Michi, A Zhernov, M Gelmi, M Selvi… - Nature, 2023 - nature.com
Fundamental algorithms such as sorting or hashing are used trillions of times on any given
day. As demand for computation grows, it has become critical for these algorithms to be as …

[HTML][HTML] Discovering faster matrix multiplication algorithms with reinforcement learning

A Fawzi, M Balog, A Huang, T Hubert… - Nature, 2022 - nature.com
Improving the efficiency of algorithms for fundamental computations can have a widespread
impact, as it can affect the overall speed of a large amount of computations. Matrix …

Neural code comprehension: A learnable representation of code semantics

T Ben-Nun, AS Jakobovits… - Advances in neural …, 2018 - proceedings.neurips.cc
With the recent success of embeddings in natural language processing, research has been
conducted into applying similar methods to code analysis. Most works attempt to process the …

Neural program repair by jointly learning to localize and repair

M Vasic, A Kanade, P Maniatis, D Bieber… - arxiv preprint arxiv …, 2019 - arxiv.org
Due to its potential to improve programmer productivity and software quality, automated
program repair has been an active topic of research. Newer techniques harness neural …

Mlgo: a machine learning guided compiler optimizations framework

M Trofin, Y Qian, E Brevdo, Z Lin… - arxiv preprint arxiv …, 2021 - arxiv.org
Leveraging machine-learning (ML) techniques for compiler optimizations has been widely
studied and explored in academia. However, the adoption of ML in general-purpose …

Supersonic: Learning to generate source code optimizations in C/C++

Z Chen, S Fang, M Monperrus - IEEE Transactions on Software …, 2024 - ieeexplore.ieee.org
Software optimization refines programs for resource efficiency while preserving functionality.
Traditionally, it is a process done by developers and compilers. This paper introduces a third …

ECCO: Can We Improve Model-Generated Code Efficiency Without Sacrificing Functional Correctness?

S Waghjale, V Veerendranath, ZZ Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
Although large language models (LLMs) have been largely successful in generating
functionally correct programs, conditioning models to produce efficient solutions while …

Anghabench: A suite with one million compilable c benchmarks for code-size reduction

AF Da Silva, BC Kind… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
A predictive compiler uses properties of a program to decide how to optimize it. The compiler
is trained on a collection of programs to derive a model which determines its actions in face …