NLP-assisted software testing: A systematic map** of the literature

V Garousi, S Bauer, M Felderer - Information and Software Technology, 2020 - Elsevier
Context To reduce manual effort of extracting test cases from natural-language
requirements, many approaches based on Natural Language Processing (NLP) have been …

Toga: A neural method for test oracle generation

E Dinella, G Ryan, T Mytkowicz, SK Lahiri - Proceedings of the 44th …, 2022 - dl.acm.org
Testing is widely recognized as an important stage of the software development lifecycle.
Effective software testing can provide benefits such as bug finding, preventing regressions …

Learning deep semantics for test completion

P Nie, R Banerjee, JJ Li, RJ Mooney… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Writing tests is a time-consuming yet essential task during software development. We
propose to leverage recent advances in deep learning for text and code generation to assist …

Code generation tools (almost) for free? a study of few-shot, pre-trained language models on code

P Bareiß, B Souza, M d'Amorim, M Pradel - arxiv preprint arxiv …, 2022 - arxiv.org
Few-shot learning with large-scale, pre-trained language models is a powerful way to
answer questions about code, eg, how to complete a given code example, or even generate …

Fuzzing deep-learning libraries via automated relational api inference

Y Deng, C Yang, A Wei, L Zhang - Proceedings of the 30th ACM Joint …, 2022 - dl.acm.org
Deep Learning (DL) has gained wide attention in recent years. Meanwhile, bugs in DL
systems can lead to serious consequences, and may even threaten human lives. As a result …

Docter: Documentation-guided fuzzing for testing deep learning api functions

D **e, Y Li, M Kim, HV Pham, L Tan, X Zhang… - Proceedings of the 31st …, 2022 - dl.acm.org
Input constraints are useful for many software development tasks. For example, input
constraints of a function enable the generation of valid inputs, ie, inputs that follow these …

Fuzzing automatic differentiation in deep-learning libraries

C Yang, Y Deng, J Yao, Y Tu, H Li… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Deep learning (DL) has attracted wide attention and has been widely deployed in recent
years. As a result, more and more research efforts have been dedicated to testing DL …

Impact of large language models on generating software specifications

D **e, B Yoo, N Jiang, M Kim, L Tan, X Zhang… - arxiv preprint arxiv …, 2023 - arxiv.org
Software specifications are essential for ensuring the reliability of software systems. Existing
specification extraction approaches, however, suffer from limited generalizability and require …

Can large language models write good property-based tests?

V Vikram, C Lemieux, J Sunshine, R Padhye - arxiv preprint arxiv …, 2023 - arxiv.org
Property-based testing (PBT), while an established technique in the software testing
research community, is still relatively underused in real-world software. Pain points in writing …

Llm-powered test case generation for detecting tricky bugs

K Liu, Y Liu, Z Chen, JM Zhang, Y Han, Y Ma… - arxiv preprint arxiv …, 2024 - arxiv.org
Conventional automated test generation tools struggle to generate test oracles and tricky
bug-revealing test inputs. Large Language Models (LLMs) can be prompted to produce test …