A survey of flaky tests
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
Exploring the intersection between software maintenance and machine learning—a systematic map** study
While some areas of software engineering knowledge present great advances with respect
to the automation of processes, tools, and practices, areas such as software maintenance …
to the automation of processes, tools, and practices, areas such as software maintenance …
[HTML][HTML] Assessing test artifact quality—A tertiary study
Context: Modern software development increasingly relies on software testing for an ever
more frequent delivery of high quality software. This puts high demands on the quality of the …
more frequent delivery of high quality software. This puts high demands on the quality of the …
Flakeflagger: Predicting flakiness without rerunning tests
When developers make changes to their code, they typically run regression tests to detect if
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …
Flakify: A black-box, language model-based predictor for flaky tests
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …
However, a test case can be flaky, ie, passing and failing across executions, even for the …
Understanding reproducibility and characteristics of flaky tests through test reruns in Java projects
Flaky tests are tests that can non-deterministically pass and fail. They pose a major
impediment to regression testing, because they provide an inconclusive assessment on …
impediment to regression testing, because they provide an inconclusive assessment on …
Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models
A flaky test is a test case whose outcome changes without modification to the code of the test
case or the program under test. These tests disrupt continuous integration, cause a loss of …
case or the program under test. These tests disrupt continuous integration, cause a loss of …
Shake it! detecting flaky tests caused by concurrency with shaker
A test is said to be flaky when it non-deterministically passes or fails. Test flakiness
negatively affects the effectiveness of regression testing and, consequently, impacts …
negatively affects the effectiveness of regression testing and, consequently, impacts …
A large-scale longitudinal study of flaky tests
Flaky tests are tests that can non-deterministically pass or fail for the same code version.
These tests undermine regression testing efficiency, because developers cannot easily …
These tests undermine regression testing efficiency, because developers cannot easily …
Flakyfix: Using large language models for predicting flaky test fix categories and test code repair
Flaky tests are problematic because they non-deterministically pass or fail for the same
software version under test, causing confusion and wasting development effort. While …
software version under test, causing confusion and wasting development effort. While …