A hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineering

A Arcuri, L Briand - Software Testing, Verification and Reliability, 2014 - Wiley Online Library
Randomized algorithms are widely used to address many types of software engineering
problems, especially in the area of software verification and validation with a strong …

A systematic literature review of techniques and metrics to reduce the cost of mutation testing

AV Pizzoleto, FC Ferrari, J Offutt, L Fernandes… - Journal of Systems and …, 2019 - Elsevier
Historically, researchers have proposed and applied many techniques to reduce the cost of
mutation testing. It has become difficult to find all techniques and to understand the cost …

Mutation testing advances: an analysis and survey

M Papadakis, M Kintis, J Zhang, Y Jia, Y Le Traon… - Advances in …, 2019 - Elsevier
Mutation testing realizes the idea of using artificial defects to support testing activities.
Mutation is typically used as a way to evaluate the adequacy of test suites, to guide the …

An Abstract Syntax Tree based static fuzzing mutation for vulnerability evolution analysis

W Zheng, P Deng, K Gui, X Wu - Information and Software Technology, 2023 - Elsevier
Context: Zero-day vulnerabilities are highly destructive and sudden. However, traditional
static and dynamic testing methods cannot efficiently detect them. Objective: In this paper, a …

Predictive mutation testing

J Zhang, Z Wang, L Zhang, D Hao, L Zang… - Proceedings of the 25th …, 2016 - dl.acm.org
Mutation testing is a powerful methodology for evaluating test suite quality. In mutation
testing, a large number of mutants are generated and executed against the test suite to …

Trivial compiler equivalence: A large scale empirical study of a simple, fast and effective equivalent mutant detection technique

M Papadakis, Y Jia, M Harman… - 2015 IEEE/ACM 37th …, 2015 - ieeexplore.ieee.org
Identifying equivalent mutants remains the largest impediment to the widespread uptake of
mutation testing. Despite being researched for more than three decades, the problem …

Higher order mutation testing

Y Jia, M Harman - Information and Software Technology, 2009 - Elsevier
This paper introduces a new paradigm for Mutation Testing, which we call Higher Order
Mutation Testing (HOM Testing). Traditional Mutation Testing considers only first order …

Threats to the validity of mutation-based test assessment

M Papadakis, C Henard, M Harman, Y Jia… - Proceedings of the 25th …, 2016 - dl.acm.org
Much research on software testing and test techniques relies on experimental studies based
on mutation testing. In this paper we reveal that such studies are vulnerable to a potential …

Prioritizing mutants to guide mutation testing

SJ Kaufman, R Featherman, J Alvin, B Kurtz… - Proceedings of the 44th …, 2022 - dl.acm.org
Mutation testing offers concrete test goals (mutants) and a rigorous test efficacy criterion, but
it is expensive due to vast numbers of mutants, many of which are neither useful nor …

Does mutation testing improve testing practices?

G Petrović, M Ivanković, G Fraser… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Various proxy metrics for test quality have been defined in order to guide developers when
writing tests. Code coverage is particularly well established in practice, even though the …