Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - ACM Transactions on …, 2024 - dl.acm.org
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …

Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Exploring parameter-efficient fine-tuning techniques for code generation with large language models

M Weyssow, X Zhou, K Kim, D Lo… - ACM Transactions on …, 2023 - dl.acm.org
Large language models (LLMs) demonstrate impressive capabilities to generate accurate
code snippets given natural language intents in a zero-shot manner, ie, without the need for …

A survey on large language models for software engineering

Q Zhang, C Fang, Y **e, Y Zhang, Y Yang… - arxiv preprint arxiv …, 2023 - arxiv.org
Software Engineering (SE) is the systematic design, development, maintenance, and
management of software applications underpinning the digital infrastructure of our modern …

Trustworthy and synergistic artificial intelligence for software engineering: Vision and roadmaps

D Lo - 2023 IEEE/ACM International Conference on Software …, 2023 - ieeexplore.ieee.org
For decades, much software engineering research has been dedicated to devising
automated solutions aimed at enhancing developer productivity and elevating software …

Mergerepair: An exploratory study on merging task-specific adapters in code llms for automated program repair

M Dehghan, JJW Wu, FH Fard, A Ouni - arxiv preprint arxiv:2408.09568, 2024 - arxiv.org
[Context] Large Language Models (LLMs) have shown good performance in several
software development-related tasks such as program repair, documentation, code …

Towards incremental learning in large language models: A critical review

M Jovanovic, P Voss - arxiv preprint arxiv:2404.18311, 2024 - arxiv.org
Incremental learning is the ability of systems to acquire knowledge over time, enabling their
adaptation and generalization to novel tasks. It is a critical ability for intelligent, real-world …

GitChameleon: Unmasking the Version-Switching Capabilities of Code Generation Models

N Islah, J Gehring, D Misra, E Muller, I Rish… - arxiv preprint arxiv …, 2024 - arxiv.org
The rapid evolution of software libraries presents a significant challenge for code generation
models, which must adapt to frequent version updates while maintaining compatibility with …

Code Review Automation Via Multi-task Federated LLM--An Empirical Study

J Kumar, S Chimalakonda - arxiv preprint arxiv:2412.15676, 2024 - arxiv.org
Code review is a crucial process before deploying code to production, as it validates the
code, provides suggestions for improvements, and identifies errors such as missed edge …

CodeLL: A Lifelong Learning Dataset to Support the Co-Evolution of Data and Language Models of Code

M Weyssow, C Di Sipio, D Di Ruscio… - Proceedings of the 21st …, 2024 - dl.acm.org
Motivated by recent work on lifelong learning applications for language models (LMs) of
code, we introduce CodeLL, a lifelong learning dataset focused on code changes. Our …