Large language models for software engineering: A systematic literature review

X Hou, Y Zhao, Y Liu, Z Yang, K Wang, L Li… - ACM Transactions on …, 2024 - dl.acm.org
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …

Evaluation of openai o1: Opportunities and challenges of agi

T Zhong, Z Liu, Y Pan, Y Zhang, Y Zhou… - arxiv preprint arxiv …, 2024 - arxiv.org
This comprehensive study evaluates the performance of OpenAI's o1-preview large
language model across a diverse array of complex reasoning tasks, spanning multiple …

What's Wrong with Your Code Generated by Large Language Models? An Extensive Study

S Dou, H Jia, S Wu, H Zheng, W Zhou, M Wu… - arxiv preprint arxiv …, 2024 - arxiv.org
The increasing development of large language models (LLMs) in code generation has
drawn significant attention among researchers. To enhance LLM-based code generation …

Agentcoder: Multi-agent-based code generation with iterative testing and optimisation

D Huang, Q Bu, JM Zhang, M Luck, H Cui - arxiv preprint arxiv …, 2023 - arxiv.org
The advancement of natural language processing (NLP) has been significantly boosted by
the development of transformer-based large language models (LLMs). These models have …

Llm-assisted code cleaning for training accurate code generators

N Jain, T Zhang, WL Chiang, JE Gonzalez… - arxiv preprint arxiv …, 2023 - arxiv.org
Natural language to code generation is an important application area of LLMs and has
received wide attention from the community. The majority of relevant studies have …

Ldb: A large language model debugger via verifying runtime execution step-by-step

L Zhong, Z Wang, J Shang - arxiv preprint arxiv:2402.16906, 2024 - arxiv.org
Large language models (LLMs) are leading significant progress in code generation. Beyond
one-pass code generation, recent works further integrate unit tests and program verifiers into …

Code generation with alphacodium: From prompt engineering to flow engineering

T Ridnik, D Kredo, I Friedman - arxiv preprint arxiv:2401.08500, 2024 - arxiv.org
Code generation problems differ from common natural language problems-they require
matching the exact syntax of the target language, identifying happy paths and edge cases …

Agents in software engineering: Survey, landscape, and vision

Y Wang, W Zhong, Y Huang, E Shi, M Yang… - arxiv preprint arxiv …, 2024 - arxiv.org
In recent years, Large Language Models (LLMs) have achieved remarkable success and
have been widely used in various downstream tasks, especially in the tasks of the software …

CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models

J Li, H Le, Y Zhou, C **ong, S Savarese… - arxiv preprint arxiv …, 2024 - arxiv.org
Pre-trained on massive amounts of code and text data, large language models (LLMs) have
demonstrated remarkable achievements in performing code generation tasks. With …

Motcoder: Elevating large language models with modular of thought for challenging programming tasks

J Li, P Chen, B **a, H Xu, J Jia - arxiv preprint arxiv:2312.15960, 2023 - arxiv.org
Large Language Models (LLMs) have showcased impressive capabilities in handling
straightforward programming tasks. However, their performance tends to falter when …