Deep learning-based software engineering: progress, challenges, and opportunities

X Chen, X Hu, Y Huang, H Jiang, W Ji, Y Jiang… - Science China …, 2025 - Springer
Researchers have recently achieved significant advances in deep learning techniques,
which in turn has substantially advanced other research disciplines, such as natural …

A survey on evaluating large language models in code generation tasks

L Chen, Q Guo, H Jia, Z Zeng, X Wang, Y Xu… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper provides a comprehensive review of the current methods and metrics used to
evaluate the performance of Large Language Models (LLMs) in code generation tasks. With …

A new era in software security: Towards self-healing software via large language models and formal verification

N Tihanyi, R Jain, Y Charalambous, MA Ferrag… - arxiv preprint arxiv …, 2023 - arxiv.org
This paper introduces an innovative approach that combines Large Language Models
(LLMs) with Formal Verification strategies for automatic software vulnerability repair. Initially …

If llm is the wizard, then code is the wand: A survey on how code empowers large language models to serve as intelligent agents

K Yang, J Liu, J Wu, C Yang, YR Fung, S Li… - arxiv preprint arxiv …, 2024 - arxiv.org
The prominent large language models (LLMs) of today differ from past language models not
only in size, but also in the fact that they are trained on a combination of natural language …

Large language models for supply chain optimization

B Li, K Mellou, B Zhang, J Pathuri… - arxiv preprint arxiv …, 2023 - arxiv.org
Supply chain operations traditionally involve a variety of complex decision making problems.
Over the last few decades, supply chains greatly benefited from advances in computation …

Rlcoder: Reinforcement learning for repository-level code completion

Y Wang, Y Wang, D Guo, J Chen, R Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Repository-level code completion aims to generate code for unfinished code snippets within
the context of a specified repository. Existing approaches mainly rely on retrieval-augmented …

[PDF][PDF] Unifying the perspectives of nlp and software engineering: A survey on language models for code

Z Zhang, C Chen, B Liu, C Liao, Z Gong… - arxiv preprint arxiv …, 2023 - simg.baai.ac.cn
In this work we systematically review the recent advancements in code processing with
language models, covering 50+ models, 30+ evaluation tasks, 170+ datasets, and 700 …

CODEP: grammatical seq2seq model for general-purpose code generation

Y Dong, G Li, Z ** - Proceedings of the 32nd ACM SIGSOFT …, 2023 - dl.acm.org
General-purpose code generation aims to automatically convert the natural language
description to code snippets in a general-purpose programming language (GPL) such as …

Reinforcement learning for generative AI: A survey

Y Cao, QZ Sheng, J McAuley, L Yao - arxiv preprint arxiv:2308.14328, 2023 - arxiv.org
Deep Generative AI has been a long-standing essential topic in the machine learning
community, which can impact a number of application areas like text generation and …

Stepcoder: Improve code generation with reinforcement learning from compiler feedback

S Dou, Y Liu, H Jia, L **ong, E Zhou, W Shen… - arxiv preprint arxiv …, 2024 - arxiv.org
The advancement of large language models (LLMs) has significantly propelled the field of
code generation. Previous work integrated reinforcement learning (RL) with compiler …