A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability

X Huang, D Kroening, W Ruan, J Sharp, Y Sun… - Computer Science …, 2020 - Elsevier
In the past few years, significant progress has been made on deep neural networks (DNNs)
in achieving human-level performance on several long-standing tasks. With the broader …

A software engineering perspective on engineering machine learning systems: State of the art and challenges

G Giray - Journal of Systems and Software, 2021 - Elsevier
Context: Advancements in machine learning (ML) lead to a shift from the traditional view of
software development, where algorithms are hard-coded by humans, to ML systems …

A survey of safety and trustworthiness of large language models through the lens of verification and validation

X Huang, W Ruan, W Huang, G **, Y Dong… - Artificial Intelligence …, 2024 - Springer
Large language models (LLMs) have exploded a new heatwave of AI for their ability to
engage end-users in human-level conversations with detailed and articulate answers across …

Software engineering for AI-based systems: a survey

S Martínez-Fernández, J Bogner, X Franch… - ACM Transactions on …, 2022 - dl.acm.org
AI-based systems are software systems with functionalities enabled by at least one AI
component (eg, for image-, speech-recognition, and autonomous driving). AI-based systems …

The role of explainability in assuring safety of machine learning in healthcare

Y Jia, J McDermid, T Lawton… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Established approaches to assuring safety-critical systems and software are difficult to apply
to systems employing ML where there is no clear, pre-defined specification against which to …

How to certify machine learning based safety-critical systems? A systematic literature review

F Tambon, G Laberge, L An, A Nikanjam… - Automated Software …, 2022 - Springer
Abstract Context Machine Learning (ML) has been at the heart of many innovations over the
past years. However, including it in so-called “safety-critical” systems such as automotive or …

[PDF][PDF] Inspect, understand, overcome: A survey of practical methods for ai safety

S Houben, S Abrecht, M Akila, A Bär… - … Neural Networks and …, 2022 - library.oapen.org
Deployment of modern data-driven machine learning methods, most often realized by deep
neural networks (DNNs), in safety-critical applications such as health care, industrial plant …

Deepgd: A multi-objective black-box test selection approach for deep neural networks

Z Aghababaeyan, M Abdellatif, M Dadkhah… - ACM Transactions on …, 2024 - dl.acm.org
Deep neural networks (DNNs) are widely used in various application domains such as
image processing, speech recognition, and natural language processing. However, testing …

Effective white-box testing of deep neural networks with adaptive neuron-selection strategy

S Lee, S Cha, D Lee, H Oh - Proceedings of the 29th ACM SIGSOFT …, 2020 - dl.acm.org
We present Adapt, a new white-box testing technique for deep neural networks. As deep
neural networks are increasingly used in safety-first applications, testing their behavior …

An overview of verification and validation challenges for inspection robots

M Fisher, RC Cardoso, EC Collins, C Dadswell… - Robotics, 2021 - mdpi.com
The advent of sophisticated robotics and AI technology makes sending humans into
hazardous and distant environments to carry out inspections increasingly avoidable. Being …