Natural language generation and understanding of big code for AI-assisted programming: A review

MF Wong, S Guo, CN Hang, SW Ho, CW Tan - Entropy, 2023 - mdpi.com
This paper provides a comprehensive review of the literature concerning the utilization of
Natural Language Processing (NLP) techniques, with a particular focus on transformer …

Deep learning-based software engineering: progress, challenges, and opportunities

X Chen, X Hu, Y Huang, H Jiang, W Ji, Y Jiang… - Science China …, 2025 - Springer
Researchers have recently achieved significant advances in deep learning techniques,
which in turn has substantially advanced other research disciplines, such as natural …

A transformer-based approach for source code summarization

WU Ahmad, S Chakraborty, B Ray… - arxiv preprint arxiv …, 2020 - arxiv.org
Generating a readable summary that describes the functionality of a program is known as
source code summarization. In this task, learning code representation by modeling the …

Few-shot training LLMs for project-specific code-summarization

T Ahmed, P Devanbu - Proceedings of the 37th IEEE/ACM International …, 2022 - dl.acm.org
Very large language models (LLMs), such as GPT-3 and Codex have achieved state-of-the-
art performance on several natural-language tasks, and show great promise also for code. A …

Improved code summarization via a graph neural network

A LeClair, S Haque, L Wu, C McMillan - Proceedings of the 28th …, 2020 - dl.acm.org
Automatic source code summarization is the task of generating natural language
descriptions for source code. Automatic code summarization is a rapidly expanding research …

Deep code comment generation

X Hu, G Li, X **a, D Lo, Z ** - Proceedings of the 26th conference on …, 2018 - dl.acm.org
During software maintenance, code comments help developers comprehend programs and
reduce additional time spent on reading and navigating source code. Unfortunately, these …

Spt-code: Sequence-to-sequence pre-training for learning source code representations

C Niu, C Li, V Ng, J Ge, L Huang, B Luo - Proceedings of the 44th …, 2022 - dl.acm.org
Recent years have seen the successful application of large pre-trained models to code
representation learning, resulting in substantial improvements on many code-related …

Improving automatic source code summarization via deep reinforcement learning

Y Wan, Z Zhao, M Yang, G Xu, H Ying, J Wu… - Proceedings of the 33rd …, 2018 - dl.acm.org
Code summarization provides a high level natural language description of the function
performed by code, as it can benefit the software maintenance, code categorization and …

Semantic similarity metrics for evaluating source code summarization

S Haque, Z Eberhart, A Bansal… - Proceedings of the 30th …, 2022 - dl.acm.org
Source code summarization involves creating brief descriptions of source code in natural
language. These descriptions are a key component of software documentation such as …

Summarizing source code using a neural attention model

S Iyer, I Konstas, A Cheung… - 54th Annual Meeting …, 2016 - researchportal.hw.ac.uk
High quality source code is often paired with high level summaries of the computation it
performs, for example in code documentation or in descriptions posted in online forums …