Large language models for software engineering: A systematic literature review
Large Language Models (LLMs) have significantly impacted numerous domains, including
Software Engineering (SE). Many recent publications have explored LLMs applied to …
Software Engineering (SE). Many recent publications have explored LLMs applied to …
A survey of flaky tests
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
Flakeflagger: Predicting flakiness without rerunning tests
When developers make changes to their code, they typically run regression tests to detect if
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …
[HTML][HTML] Assessing test artifact quality—A tertiary study
Context: Modern software development increasingly relies on software testing for an ever
more frequent delivery of high quality software. This puts high demands on the quality of the …
more frequent delivery of high quality software. This puts high demands on the quality of the …
A study on the lifecycle of flaky tests
During regression testing, developers rely on the pass or fail outcomes of tests to check
whether changes broke existing functionality. Thus, flaky tests, which nondeterministically …
whether changes broke existing functionality. Thus, flaky tests, which nondeterministically …
An empirical study of flaky tests in python
Tests that cause spurious failures without any code changes, ie, flaky tests, hamper
regression testing, increase maintenance costs, may shadow real bugs, and decrease trust …
regression testing, increase maintenance costs, may shadow real bugs, and decrease trust …
What is the vocabulary of flaky tests?
Flaky tests are tests whose outcomes are non-deterministic. Despite the recent research
activity on this topic, no effort has been made on understanding the vocabulary of flaky tests …
activity on this topic, no effort has been made on understanding the vocabulary of flaky tests …
Flakify: A black-box, language model-based predictor for flaky tests
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …
However, a test case can be flaky, ie, passing and failing across executions, even for the …
Understanding reproducibility and characteristics of flaky tests through test reruns in Java projects
Flaky tests are tests that can non-deterministically pass and fail. They pose a major
impediment to regression testing, because they provide an inconclusive assessment on …
impediment to regression testing, because they provide an inconclusive assessment on …
Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models
A flaky test is a test case whose outcome changes without modification to the code of the test
case or the program under test. These tests disrupt continuous integration, cause a loss of …
case or the program under test. These tests disrupt continuous integration, cause a loss of …