Large Language Models (LLMs) play an ever-increasing role in the field of Artificial
Intelligence (AI)--not only for natural language processing but also for code understanding …

The BigCode project is an open-scientific collaboration working on the responsible
development of large language models for code. This tech report describes the progress of …

Finetuning large language models (LLMs) on instructions leads to vast performance
improvements on natural language tasks. We apply instruction tuning using code …

Large language models have demonstrated the ability to generate both natural language
and programming language text. Although contemporary code generation models are …

Large Language Models (LLMs) have shown impressive abilities in code generation. Chain-
of-Thought (CoT) prompting is the state-of-the-art approach to utilizing LLMs. CoT prompting …

Large language models (LLMs) demonstrate impressive capabilities to generate accurate
code snippets given natural language intents in a zero-shot manner, ie, without the need for …

Code completion models have made significant progress in recent years, yet current popular
evaluation datasets, such as HumanEval and MBPP, predominantly focus on code …

In this work, we make the first attempt to evaluate LLMs in a more challenging code
generation scenario, ie class-level code generation. We first manually construct the first …

A code generation model generates code by taking a prompt from a code comment, existing
code, or a combination of both. Although code generation models (eg, GitHub Copilot) are …

General large language models (LLMs), represented by ChatGPT, have demonstrated
significant potential in tasks such as code generation in software engineering. This has led …