[HTML][HTML] A survey of GPT-3 family large language models including ChatGPT and GPT-4

KS Kalyan - Natural Language Processing Journal, 2024 - Elsevier
Large language models (LLMs) are a special class of pretrained language models (PLMs)
obtained by scaling model size, pretraining corpus and computation. LLMs, because of their …

Natural language generation and understanding of big code for AI-assisted programming: A review

MF Wong, S Guo, CN Hang, SW Ho, CW Tan - Entropy, 2023 - mdpi.com
This paper provides a comprehensive review of the literature concerning the utilization of
Natural Language Processing (NLP) techniques, with a particular focus on transformer …

Automated program repair in the era of large pre-trained language models

CS **a, Y Wei, L Zhang - 2023 IEEE/ACM 45th International …, 2023 - ieeexplore.ieee.org
Automated Program Repair (APR) aims to help developers automatically patch software
bugs. However, current state-of-the-art traditional and learning-based APR techniques face …

An empirical evaluation of using large language models for automated unit test generation

M Schäfer, S Nadi, A Eghbali… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Unit tests play a key role in ensuring the correctness of software. However, manually
creating unit tests is a laborious task, motivating the need for automation. Large Language …

Impact of code language models on automated program repair

N Jiang, K Liu, T Lutellier, L Tan - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Automated program repair (APR) aims to help developers improve software reliability by
generating patches for buggy programs. Although many code language models (CLM) are …

Keep the Conversation Going: Fixing 162 out of 337 bugs for $0.42 each using ChatGPT

CS **a, L Zhang - arxiv preprint arxiv:2304.00385, 2023 - arxiv.org
Automated Program Repair (APR) aims to automatically generate patches for buggy
programs. Recent APR work has been focused on leveraging modern Large Language …

Inferfix: End-to-end program repair with llms

M **, S Shahriar, M Tufano, X Shi, S Lu… - Proceedings of the 31st …, 2023 - dl.acm.org
Software development life cycle is profoundly influenced by bugs; their introduction,
identification, and eventual resolution account for a significant portion of software …

Copiloting the copilots: Fusing large language models with completion engines for automated program repair

Y Wei, CS **a, L Zhang - Proceedings of the 31st ACM Joint European …, 2023 - dl.acm.org
During Automated Program Repair (APR), it can be challenging to synthesize correct
patches for real-world systems in general-purpose programming languages. Recent Large …

Swe-bench: Can language models resolve real-world github issues?

CE Jimenez, J Yang, A Wettig, S Yao, K Pei… - arxiv preprint arxiv …, 2023 - arxiv.org
Language models have outpaced our ability to evaluate them effectively, but for their future
development it is essential to study the frontier of their capabilities. We find real-world …

Large language models are few-shot testers: Exploring llm-based general bug reproduction

S Kang, J Yoon, S Yoo - 2023 IEEE/ACM 45th International …, 2023 - ieeexplore.ieee.org
Many automated test generation techniques have been developed to aid developers with
writing tests. To facilitate full automation, most existing techniques aim to either increase …