A survey of compiler testing

J Chen, J Patra, M Pradel, Y **ong, H Zhang… - ACM Computing …, 2020 - dl.acm.org
Virtually any software running on a computer has been processed by a compiler or a
compiler-like tool. Because compilers are such a crucial piece of infrastructure for building …

Search-based software engineering: Trends, techniques and applications

M Harman, SA Mansouri, Y Zhang - ACM Computing Surveys (CSUR), 2012 - dl.acm.org
In the past five years there has been a dramatic increase in work on Search-Based Software
Engineering (SBSE), an approach to Software Engineering (SE) in which Search-Based …

An empirical evaluation of using large language models for automated unit test generation

M Schäfer, S Nadi, A Eghbali… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Unit tests play a key role in ensuring the correctness of software. However, manually
creating unit tests is a laborious task, motivating the need for automation. Large Language …

Automated unit test improvement using large language models at meta

N Alshahwan, J Chheda, A Finogenova… - … Proceedings of the …, 2024 - dl.acm.org
This paper describes Meta's TestGen-LLM tool, which uses LLMs to automatically improve
existing human-written tests. TestGen-LLM verifies that its generated test classes …

Code-aware prompting: A study of coverage-guided test generation in regression setting using llm

G Ryan, S Jain, M Shang, S Wang, X Ma… - Proceedings of the …, 2024 - dl.acm.org
Testing plays a pivotal role in ensuring software quality, yet conventional Search Based
Software Testing (SBST) methods often struggle with complex software units, achieving …

Guiding deep learning system testing using surprise adequacy

J Kim, R Feldt, S Yoo - 2019 IEEE/ACM 41st International …, 2019 - ieeexplore.ieee.org
Deep Learning (DL) systems are rapidly being adopted in safety and security critical
domains, urgently calling for ways to test their correctness and robustness. Testing of DL …

A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

The oracle problem in software testing: A survey

ET Barr, M Harman, P McMinn… - IEEE transactions on …, 2014 - ieeexplore.ieee.org
Testing involves examining the behaviour of a system in order to discover potential faults.
Given an input for a system, the challenge of distinguishing the corresponding desired …

A survey on metamorphic testing

S Segura, G Fraser, AB Sanchez… - IEEE Transactions on …, 2016 - ieeexplore.ieee.org
A test oracle determines whether a test execution reveals a fault, often by comparing the
observed program output to the expected output. This is not always practical, for example …

Usage, costs, and benefits of continuous integration in open-source projects

M Hilton, T Tunnell, K Huang, D Marinov… - Proceedings of the 31st …, 2016 - dl.acm.org
Continuous integration (CI) systems automate the compilation, building, and testing of
software. Despite CI rising as a big success story in automated software engineering, it has …