Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - ACM Transactions on …, 2024‏ - dl.acm.org
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …

Robustness, security, privacy, explainability, efficiency, and usability of large language models for code

Z Yang, Z Sun, TZ Yue, P Devanbu, D Lo - arxiv preprint arxiv:2403.07506, 2024‏ - arxiv.org
Large language models for code (LLM4Code), which demonstrate strong performance (eg,
high accuracy) in processing source code, have significantly transformed software …

A survey on large language models for software engineering

Q Zhang, C Fang, Y **e, Y Zhang, Y Yang… - arxiv preprint arxiv …, 2023‏ - arxiv.org
Software Engineering (SE) is the systematic design, development, maintenance, and
management of software applications underpinning the digital infrastructure of our modern …

Efficient and green large language models for software engineering: Vision and the road ahead

J Shi, Z Yang, D Lo - ACM Transactions on Software Engineering and …, 2024‏ - dl.acm.org
Large Language Models (LLMs) have recently shown remarkable capabilities in various
software engineering tasks, spurring the rapid growth of the Large Language Models for …

When to stop? towards efficient code generation in llms with excess token prevention

L Guo, Y Wang, E Shi, W Zhong, H Zhang… - Proceedings of the 33rd …, 2024‏ - dl.acm.org
Code generation aims to automatically generate code snippets that meet given natural
language requirements and plays an important role in software development. Although …

Efficient and Green Large Language Models for Software Engineering: Literature Review, Vision, and the Road Ahead

J Shi, Z Yang, D Lo - arxiv preprint arxiv:2404.04566, 2024‏ - arxiv.org
Large Language Models (LLMs) have recently shown remarkable capabilities in various
software engineering tasks, spurring the rapid growth of the Large Language Models for …

Anchor Attention, Small Cache: Code Generation with Large Language Models

X Zhang, Y Zhou, G Yang, HC Gall, T Chen - arxiv preprint arxiv …, 2024‏ - arxiv.org
The development of large language models (LLMs) has revolutionized automated code
generation. However, their high demand of computation resources has hindered a broader …

On the Compression of Language Models for Code: An Empirical Study on CodeBERT

G d'Aloisio, L Traini, F Sarro, A Di Marco - arxiv preprint arxiv:2412.13737, 2024‏ - arxiv.org
Language models have proven successful across a wide range of software engineering
tasks, but their significant computational costs often hinder their practical adoption. To …

API-guided Dataset Synthesis to Finetune Large Code Models

Z Li, D Wu, S Wang, Z Su - arxiv preprint arxiv:2408.08343, 2024‏ - arxiv.org
Large code models (LCMs), pre-trained on vast code corpora, have demonstrated
remarkable performance across a wide array of code-related tasks. Supervised fine-tuning …

GREEN-CODE: Optimizing Energy Efficiency in Large Language Models for Code Generation

S Ilager, LF Briem, I Brandic - arxiv preprint arxiv:2501.11006, 2025‏ - arxiv.org
Large Language Models (LLMs) are becoming integral to daily life, showcasing their vast
potential across various Natural Language Processing (NLP) tasks. Beyond NLP, LLMs are …