A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability

X Huang, D Kroening, W Ruan, J Sharp, Y Sun… - Computer Science …, 2020 - Elsevier
In the past few years, significant progress has been made on deep neural networks (DNNs)
in achieving human-level performance on several long-standing tasks. With the broader …

On testing machine learning programs

HB Braiek, F Khomh - Journal of Systems and Software, 2020 - Elsevier
Nowadays, we are witnessing a wide adoption of Machine learning (ML) models in many
software systems. They are even being tested in safety-critical systems, thanks to recent …

Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arxiv preprint arxiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Ijon: Exploring deep state spaces via fuzzing

C Aschermann, S Schumilo, A Abbasi… - 2020 IEEE Symposium …, 2020 - ieeexplore.ieee.org
Although current fuzz testing (fuzzing) methods are highly effective, there are still many
situations such as complex state machines where fully automated approaches fail. State-of …

Applications of AI in classical software engineering

M Barenkamp, J Rebstadt, O Thomas - AI Perspectives, 2020 - Springer
Abstract Although Artificial Intelligence (AI) has become a buzzword for self-organizing IT
applications, its relevance to software engineering has hardly been analyzed systematically …

Deepmutation++: A mutation testing framework for deep learning systems

Q Hu, L Ma, X **e, B Yu, Y Liu… - 2019 34th IEEE/ACM …, 2019 - ieeexplore.ieee.org
Deep neural networks (DNNs) are increasingly expanding their real-world applications
across domains, eg, image processing, speech recognition and natural language …

[PDF][PDF] Metamorphic Testing and Certified Mitigation of Fairness Violations in NLP Models.

P Ma, S Wang, J Liu - IJCAI, 2020 - ijcai.org
Natural language processing (NLP) models have been increasingly used in sensitive
application domains including credit scoring, insurance, and loan assessment. Hence, it is …

Metamorphic object insertion for testing object detection systems

S Wang, Z Su - Proceedings of the 35th IEEE/ACM International …, 2020 - dl.acm.org
Recent advances in deep neural networks (DNNs) have led to object detectors (ODs) that
can rapidly process pictures or videos, and recognize the objects that they contain. Despite …

Verification for machine learning, autonomy, and neural networks survey

W **ang, P Musau, AA Wild, DM Lopez… - arxiv preprint arxiv …, 2018 - arxiv.org
This survey presents an overview of verification techniques for autonomous systems, with a
focus on safety-critical autonomous cyber-physical systems (CPS) and subcomponents …