Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Metamorphic testing is an approach to both test case generation and test result verification.
A central element is a set of metamorphic relations, which are necessary properties of the …

This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Recent advances in Deep Neural Networks (DNNs) have led to the development of DNN-
driven autonomous cars that, using sensors like camera, LiDAR, etc., can drive without any …

While Deep Neural Networks (DNNs) have established the fundamentals of image-based
autonomous driving systems, they may exhibit erroneous behaviors and cause fatal …

A test oracle determines whether a test execution reveals a fault, often by comparing the
observed program output to the expected output. This is not always practical, for example …

Nowadays, we are witnessing a wide adoption of Machine learning (ML) models in many
software systems. They are even being tested in safety-critical systems, thanks to recent …

Machine learning algorithms have provided core functionality to many application domains–
such as bioinformatics, computational linguistics, etc. However, it is difficult to detect faults in …

Machine Learning (ML) provides approaches which use big data to enable algorithms to"
learn", producing outputs which would be difficult to obtain otherwise. Despite the advances …

Web Application Programming Interfaces (APIs) specify how to access services and data
over the network, typically using Web services. Web APIs are rapidly proliferating as a key …