Is ChatGPT the ultimate programming assistant--how far is it?

H Tian, W Lu, TO Li, X Tang, SC Cheung… - arxiv preprint arxiv …, 2023 - arxiv.org
Recently, the ChatGPT LLM has received great attention: it can be used as a bot for
discussing source code, prompting it to suggest changes, provide descriptions or even …

Octopack: Instruction tuning code large language models

N Muennighoff, Q Liu, A Zebaze, Q Zheng… - arxiv preprint arxiv …, 2023 - arxiv.org
Finetuning large language models (LLMs) on instructions leads to vast performance
improvements on natural language tasks. We apply instruction tuning using code …

Few-shot training LLMs for project-specific code-summarization

T Ahmed, P Devanbu - Proceedings of the 37th IEEE/ACM International …, 2022 - dl.acm.org
Very large language models (LLMs), such as GPT-3 and Codex have achieved state-of-the-
art performance on several natural-language tasks, and show great promise also for code. A …

Pitfalls in language models for code intelligence: A taxonomy and survey

X She, Y Liu, Y Zhao, Y He, L Li… - arxiv preprint arxiv …, 2023 - arxiv.org
Modern language models (LMs) have been successfully employed in source code
generation and understanding, leading to a significant increase in research focused on …

Recommending root-cause and mitigation steps for cloud incidents using large language models

T Ahmed, S Ghosh, C Bansal… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Incident management for cloud services is a complex process involving several steps and
has a huge impact on both service health and developer productivity. On-call engineers …

Towards efficient fine-tuning of pre-trained code models: An experimental study and beyond

E Shi, Y Wang, H Zhang, L Du, S Han… - Proceedings of the …, 2023 - dl.acm.org
Recently, fine-tuning pre-trained code models such as CodeBERT on downstream tasks has
achieved great success in many software testing and analysis tasks. While effective and …

Automatic code summarization via chatgpt: How far are we?

W Sun, C Fang, Y You, Y Miao, Y Liu, Y Li… - arxiv preprint arxiv …, 2023 - arxiv.org
To support software developers in understanding and maintaining programs, various
automatic code summarization techniques have been proposed to generate a concise …

A catalog of data smells for coding tasks

A Vitale, R Oliveto, S Scalabrino - ACM Transactions on Software …, 2024 - dl.acm.org
Large Language Models (LLMs) are increasingly becoming fundamental in supporting
software developers in coding tasks. The massive datasets used for training LLMs are often …

Binary code summarization: Benchmarking chatgpt/gpt-4 and other large language models

X **, J Larson, W Yang, Z Lin - arxiv preprint arxiv:2312.09601, 2023 - arxiv.org
Binary code summarization, while invaluable for understanding code semantics, is
challenging due to its labor-intensive nature. This study delves into the potential of large …

Source code summarization in the era of large language models

W Sun, Y Miao, Y Li, H Zhang, C Fang, Y Liu… - arxiv preprint arxiv …, 2024 - arxiv.org
To support software developers in understanding and maintaining programs, various
automatic (source) code summarization techniques have been proposed to generate a …