Flakify: A black-box, language model-based predictor for flaky tests
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …
However, a test case can be flaky, ie, passing and failing across executions, even for the …
Empirically evaluating flaky test detection techniques combining test case rerunning and machine learning models
A flaky test is a test case whose outcome changes without modification to the code of the test
case or the program under test. These tests disrupt continuous integration, cause a loss of …
case or the program under test. These tests disrupt continuous integration, cause a loss of …
Flakyfix: Using large language models for predicting flaky test fix categories and test code repair
Flaky tests are problematic because they non-deterministically pass or fail for the same
software version under test, causing confusion and wasting development effort. While …
software version under test, causing confusion and wasting development effort. While …
On the use of test smells for prediction of flaky tests
Regression testing is an important phase to deliver software with quality. However, flaky
tests hamper the evaluation of test results and can increase costs. This is because a flaky …
tests hamper the evaluation of test results and can increase costs. This is because a flaky …
Predicting flaky tests categories using few-shot learning
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …
program. This non-deterministic behaviour plagues continuous integration with false signals …
Toward static test flakiness prediction: A feasibility study
Flaky tests are tests that exhibit both a passing and failing behavior when run against the
same code. While the research community has attempted to define automated approaches …
same code. While the research community has attempted to define automated approaches …
Static test flakiness prediction: How far can we go?
Test flakiness is a phenomenon occurring when a test case is non-deterministic and exhibits
both a passing and failing behavior when run against the same code. Over the last years …
both a passing and failing behavior when run against the same code. Over the last years …
FlakyCat: Predicting flaky tests categories using few-shot learning
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …
program. This non-deterministic behaviour plagues continuous integration with false signals …
[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …
testing. They are known to cause significant issues, such as reducing the effectiveness and …
Flakime: laboratory-controlled test flakiness impact assessment
Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …
deterministic such that they always witness the presence of the same defects. However, this …