A meta-summary of challenges in building products with ml components–collecting experiences from 4758+ practitioners

N Nahar, H Zhang, G Lewis, S Zhou… - 2023 IEEE/ACM 2nd …, 2023 - ieeexplore.ieee.org
Incorporating machine learning (ML) components into software products raises new
software-engineering challenges and exacerbates existing ones. Many researchers have …

Reusing deep learning models: Challenges and directions in software engineering

JC Davis, P Jajal, W Jiang… - 2023 IEEE John …, 2023 - ieeexplore.ieee.org
Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including
computer vision, system configuration, and question-answering. However, DNNs are …

Peatmoss: A dataset and initial analysis of pre-trained models in open-source software

W Jiang, J Yasmin, J Jones, N Synovic, J Kuo… - Proceedings of the 21st …, 2024 - dl.acm.org
The development and training of deep learning models have become increasingly costly
and complex. Consequently, software engineers are adopting pre-trained models (PTMs) for …

[HTML][HTML] Software engineering practices for machine learning—Adoption, effects, and team assessment

A Serban, K van der Blom, H Hoos, J Visser - Journal of Systems and …, 2024 - Elsevier
Abstract Machine learning (ML) is extensively used in production-ready applications, calling
for mature engineering techniques to ensure robust development, deployment and …

Test & evaluation best practices for machine learning-enabled systems

J Chandrasekaran, T Cody, N McCarthy… - arxiv preprint arxiv …, 2023 - arxiv.org
Machine learning (ML)-based software systems are rapidly gaining adoption across various
domains, making it increasingly essential to ensure they perform as intended. This report …

The Product Beyond the Model--An Empirical Study of Repositories of Open-Source ML Products

N Nahar, H Zhang, G Lewis, S Zhou… - arxiv preprint arxiv …, 2023 - arxiv.org
Machine learning (ML) components are increasingly incorporated into software products for
end-users, but developers face challenges in transitioning from ML prototypes to products …

Robustness evaluation for safety-critical systems utilizing artificial neural network classifiers in operation: a survey

J Zhang, J Li, J Oehmen - Available at SSRN 4513915, 2023 - papers.ssrn.com
Artificial neural networks (ANNs) have become increasingly prevalent in various industries,
with applications in safety-critical domains such as image recognition, medical diagnosis …

An Exploratory Study of V-Model in Building ML-Enabled Software: A Systems Engineering Perspective

JJW Wu - Proceedings of the IEEE/ACM 3rd International …, 2024 - dl.acm.org
Machine learning (ML) components are being added to more and more critical and impactful
software systems, but the software development process of real-world production systems …

Testing Machine Learning: Best Practices for the Life Cycle

J Chandrasekaran, T Cody, N McCarthy… - Naval Engineers …, 2024 - ingentaconnect.com
Artificial Intelligence (AI) enabled systems are becoming capable and widespread. The use
of AI in critical system functions warrants a review of existing test and evaluation (T&E) tools …

A Quantitative Comparison of Pre-Trained Model Registries to Traditional Software Package Registries

J Jones - 2024 - search.proquest.com
Abstract Software Package Registries are an integral part of the Software Supply Chain,
acting as collaborative platforms that unite contributors, users, and packages, and …