Cit4dnn: Generating diverse and rare inputs for neural networks using latent space combinatorial testing

S Dola, R McDaniel, MB Dwyer, ML Soffa - Proceedings of the IEEE …, 2024 - dl.acm.org
Deep neural networks (DNN) are being used in a wide range of applications including safety-
critical systems. Several DNN test generation approaches have been proposed to generate …

Test & evaluation best practices for machine learning-enabled systems

J Chandrasekaran, T Cody, N McCarthy… - arxiv preprint arxiv …, 2023 - arxiv.org
Machine learning (ML)-based software systems are rapidly gaining adoption across various
domains, making it increasingly essential to ensure they perform as intended. This report …

Self‐supervised cross validation using data generation structure

RS Kenett, C Gotwalt, L Freeman… - … Stochastic Models in …, 2022 - Wiley Online Library
Modern statistics and machine learning typically involve large amounts of data coupled with
computationally intensive methods. In a predictive modeling context, one seeks models that …

Bridging the Data Gap in AI Reliability Research and Establishing DR-AIR, a Comprehensive Data Repository for AI Reliability

S Zheng, JM Clark, F Salboukh, P Silva… - arxiv preprint arxiv …, 2025 - arxiv.org
Artificial intelligence (AI) technology and systems have been advancing rapidly. However,
ensuring the reliability of these systems is crucial for fostering public confidence in their use …

Underwater SONAR Image Classification and Analysis using LIME-based Explainable Artificial Intelligence

P Natarajan, A Nambiar - arxiv preprint arxiv:2408.12837, 2024 - arxiv.org
Deep learning techniques have revolutionized image classification by mimicking human
cognition and automating complex decision-making processes. However, the deployment of …

Active learning with combinatorial coverage

SP Katragadda, T Cody, P Beling… - 2022 21st IEEE …, 2022 - ieeexplore.ieee.org
Active learning is a practical field of machine learning that automates the process of
selecting which data to label. Current methods are effective in reducing the burden of data …

On extending the automatic test markup language (ATML) for machine learning

T Cody, B Li, P Beling - 2024 IEEE International Systems …, 2024 - ieeexplore.ieee.org
This paper addresses the urgent need for messaging standards in the operational test and
evaluation (T&E) of machine learning (ML) applications, particularly in edge ML applications …

Statistical engineering–part 2: Future

CM Anderson-Cook, L Lu, W Brenneman… - Quality …, 2022 - Taylor & Francis
In the second of two panel discussion articles focused on the evolution of statistical
engineering (SE) as introduced by Roger Hoerl and Ronald Snee, a group of leading …

Leveraging Combinatorial Coverage in the Machine Learning Product Lifecycle

J Chandrasekaran, E Lanus, T Cody, LJ Freeman… - Computer, 2024 - ieeexplore.ieee.org
The data-intensive nature of machine learning (ML)-enabled systems introduces unique
challenges in test and evaluation. We present an overview of combinatorial coverage …

Metric learning improves the ability of combinatorial coverage metrics to anticipate classification error

T Cody, L Freeman - 2023 IEEE International Conference on …, 2023 - ieeexplore.ieee.org
Machine learning models are increasingly used in practice. However, many machine
learning methods are sensitive to test or operational data that is dissimilar to training data …