Automatic program repair papers tend to repeatedly use the same benchmarks. This poses
a threat to the external validity of the findings of the program repair research community. In …

We report on the organization, challenges, and results of the ninth edition of the Java Unit
Testing Competition as well as the first edition of the Cyber-Physical Systems Testing Tool …

In this paper, we do automatic correctness assessment for patches generated by program
repair systems. We consider the human-written patch as ground truth oracle and randomly …

Test smells aim to capture design issues in test code that reduces its maintainability. These
have been extensively studied and generally found quite prevalent in both human-written …

Test smells attempt to capture design issues in test code that reduce their maintainability.
Previous work found such smells to be highly common in automatically generated test …

Search-based software testing (SBST) is now a mature area, with numerous techniques
developed to tackle the challenging task of software testing. SBST techniques have shown …

Software testing is an important and time-consuming task that is often done manually. In the
last decades, researchers have come up with techniques to generate input data (eg, fuzzing) …

Search-based test case generation approaches make use of static type information to
determine which data types should be used for the creation of new test cases. Dynamically …

This report describes Test-Comp 2021, the 3rd edition of the Competition on Software
Testing. The competition is a series of annual comparative evaluations of fully automatic …

Context A software product line (SPL) grows in size as a new product is developed. A new
product in an SPL should be tested extensively for quality assurance. For the efficient …