A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability

X Huang, D Kroening, W Ruan, J Sharp, Y Sun… - Computer Science …, 2020 - Elsevier
In the past few years, significant progress has been made on deep neural networks (DNNs)
in achieving human-level performance on several long-standing tasks. With the broader …

Testing machine learning based systems: a systematic map**

V Riccio, G Jahangirova, A Stocco… - Empirical Software …, 2020 - Springer
Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

The art, science, and engineering of fuzzing: A survey

VJM Manès, HS Han, C Han, SK Cha… - IEEE Transactions …, 2019 - ieeexplore.ieee.org
Among the many software testing techniques available today, fuzzing has remained highly
popular due to its conceptual simplicity, its low barrier to deployment, and its vast amount of …

Securing connected & autonomous vehicles: Challenges posed by adversarial machine learning and the way forward

A Qayyum, M Usama, J Qadir… - … Surveys & Tutorials, 2020 - ieeexplore.ieee.org
Connected and autonomous vehicles (CAVs) will form the backbone of future next-
generation intelligent transportation systems (ITS) providing travel comfort, road safety …

A software engineering perspective on engineering machine learning systems: State of the art and challenges

G Giray - Journal of Systems and Software, 2021 - Elsevier
Context: Advancements in machine learning (ML) lead to a shift from the traditional view of
software development, where algorithms are hard-coded by humans, to ML systems …

On testing machine learning programs

HB Braiek, F Khomh - Journal of Systems and Software, 2020 - Elsevier
Nowadays, we are witnessing a wide adoption of Machine learning (ML) models in many
software systems. They are even being tested in safety-critical systems, thanks to recent …

A systematic literature review on the use of deep learning in software engineering research

C Watson, N Cooper, DN Palacio, K Moran… - ACM Transactions on …, 2022 - dl.acm.org
An increasingly popular set of techniques adopted by software engineering (SE)
researchers to automate development tasks are those rooted in the concept of Deep …

Model-based exploration of the frontier of behaviours for deep learning system testing

V Riccio, P Tonella - Proceedings of the 28th ACM Joint Meeting on …, 2020 - dl.acm.org
With the increasing adoption of Deep Learning (DL) for critical tasks, such as autonomous
driving, the evaluation of the quality of systems that rely on DL has become crucial. Once …

Muffin: Testing deep learning libraries via neural architecture fuzzing

J Gu, X Luo, Y Zhou, X Wang - … of the 44th International Conference on …, 2022 - dl.acm.org
Deep learning (DL) techniques are proven effective in many challenging tasks, and become
widely-adopted in practice. However, previous work has shown that DL libraries, the basis of …