Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - ACM Transactions on …, 2024 - dl.acm.org
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …

Automating code-related tasks through transformers: The impact of pre-training

R Tufano, L Pascarella, G Bavota - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Transformers have gained popularity in the software engineering (SE) literature. These deep
learning models are usually pre-trained through a self-supervised objective, meant to …

Using transfer learning for code-related tasks

A Mastropaolo, N Cooper, DN Palacio… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Deep learning (DL) techniques have been used to support several code-related tasks such
as code summarization and bug-fixing. In particular, pre-trained transformer models are on …

A survey on large language models for software engineering

Q Zhang, C Fang, Y **e, Y Zhang, Y Yang… - arxiv preprint arxiv …, 2023 - arxiv.org
Software Engineering (SE) is the systematic design, development, and maintenance of
software applications, underpinning the digital infrastructure of our modern mainworld. Very …

From commit message generation to history-aware commit message completion

A Eliseeva, Y Sokolov, E Bogomolov… - 2023 38th IEEE/ACM …, 2023 - ieeexplore.ieee.org
Commit messages are crucial to software development, allowing developers to track
changes and collaborate effectively. Despite their utility, most commit messages lack …

Are your comments outdated? Toward automatically detecting code‐comment consistency

Y Huang, Y Chen, X Chen… - Journal of Software …, 2025 - Wiley Online Library
In software development and maintenance, code comments can help developers
understand source code and improve communication among developers. However …

Predictive comment updating with heuristics and ast-path-based neural learning: A two-phase approach

B Lin, S Wang, Z Liu, X **a… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Just-in-time comment update is a promising way to reduce the burden of developers during
software maintenance and evolution. Existing approaches can be divided into two …

Enriching source code with contextual data for code completion models: An empirical study

T van Dam, M Izadi… - 2023 IEEE/ACM 20th …, 2023 - ieeexplore.ieee.org
Transformer-based pre-trained models have recently achieved great results in solving many
software engineering tasks including automatic code completion which is a staple in a …

A catalog of data smells for coding tasks

A Vitale, R Oliveto, S Scalabrino - ACM Transactions on Software …, 2024 - dl.acm.org
Large Language Models (LLMs) are increasingly becoming fundamental in supporting
software developers in coding tasks. The massive datasets used for training LLMs are often …

Automated variable renaming: are we there yet?

A Mastropaolo, E Aghajani, L Pascarella… - Empirical Software …, 2023 - Springer
Identifiers, such as method and variable names, form a large portion of source code.
Therefore, low-quality identifiers can substantially hinder code comprehension. To support …