Is ChatGPT the ultimate programming assistant--how far is it?

H Tian, W Lu, TO Li, X Tang, SC Cheung… - arxiv preprint arxiv …, 2023 - arxiv.org
Recently, the ChatGPT LLM has received great attention: it can be used as a bot for
discussing source code, prompting it to suggest changes, provide descriptions or even …

Octopack: Instruction tuning code large language models

N Muennighoff, Q Liu, A Zebaze, Q Zheng… - arxiv preprint arxiv …, 2023 - arxiv.org
Finetuning large language models (LLMs) on instructions leads to vast performance
improvements on natural language tasks. We apply instruction tuning using code …

A survey of automatic source code summarization

C Zhang, J Wang, Q Zhou, T Xu, K Tang, H Gui, F Liu - Symmetry, 2022 - mdpi.com
Source code summarization refers to the natural language description of the source code's
function. It can help developers easily understand the semantics of the source code. We can …

An extensive study on pre-trained models for program understanding and generation

Z Zeng, H Tan, H Zhang, J Li, Y Zhang… - Proceedings of the 31st …, 2022 - dl.acm.org
Automatic program understanding and generation techniques could significantly advance
the productivity of programmers and have been widely studied by academia and industry …

Few-shot training LLMs for project-specific code-summarization

T Ahmed, P Devanbu - Proceedings of the 37th IEEE/ACM International …, 2022 - dl.acm.org
Very large language models (LLMs), such as GPT-3 and Codex have achieved state-of-the-
art performance on several natural-language tasks, and show great promise also for code. A …

Pitfalls in language models for code intelligence: A taxonomy and survey

X She, Y Liu, Y Zhao, Y He, L Li… - arxiv preprint arxiv …, 2023 - arxiv.org
Modern language models (LMs) have been successfully employed in source code
generation and understanding, leading to a significant increase in research focused on …

Recommending root-cause and mitigation steps for cloud incidents using large language models

T Ahmed, S Ghosh, C Bansal… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Incident management for cloud services is a complex process involving several steps and
has a huge impact on both service health and developer productivity. On-call engineers …

Multilingual training for software engineering

T Ahmed, P Devanbu - Proceedings of the 44th International Conference …, 2022 - dl.acm.org
Well-trained machine-learning models, which leverage large amounts of open-source
software data, have now become an interesting approach to automating many software …

Towards efficient fine-tuning of pre-trained code models: An experimental study and beyond

E Shi, Y Wang, H Zhang, L Du, S Han… - Proceedings of the …, 2023 - dl.acm.org
Recently, fine-tuning pre-trained code models such as CodeBERT on downstream tasks has
achieved great success in many software testing and analysis tasks. While effective and …

Automatic code summarization via chatgpt: How far are we?

W Sun, C Fang, Y You, Y Miao, Y Liu, Y Li… - arxiv preprint arxiv …, 2023 - arxiv.org
To support software developers in understanding and maintaining programs, various
automatic code summarization techniques have been proposed to generate a concise …