An empirical study of testing machine learning in the wild

M Openja, F Khomh, A Foundjem, ZM Jiang… - ACM Transactions on …, 2024 - dl.acm.org
Background: Recently, machine and deep learning (ML/DL) algorithms have been
increasingly adopted in many software systems. Due to their inductive nature, ensuring the …

A controlled experiment on time pressure and confirmation bias in functional software testing

I Salman, B Turhan, S Vegas - Empirical Software Engineering, 2019 - Springer
Context Confirmation bias is a person's tendency to look for evidence that strengthens
his/her prior beliefs rather than refutes them. Manifestation of confirmation bias in software …

What leads to a confirmatory or disconfirmatory behavior of software testers?

I Salman, P Rodriguez, B Turhan… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
Background: The existing literature in software engineering reports adverse effects of
confirmation bias on software testing. Confirmation bias among software testers leads to …

Test polarity: detecting positive and negative tests

A Hora - Companion Proceedings of the 32nd ACM …, 2024 - dl.acm.org
Positive tests (aka, happy path tests) cover the expected behavior of the program, while
negative tests (aka, unhappy path tests) check the unexpected behavior. Ideally, test suites …

Confirmation Bias and Time Pressure: A Family of Experiments in Software Testing

I Salman, B Turhan, R Ramač… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Background: Software testers manifest confirmation bias (the cognitive tendency) when they
design relatively more specification consistent test cases than specification inconsistent test …

Studying the Practices of Testing Machine Learning Software in the Wild

M Openja, F Khomh, A Foundjem, Z Ming… - arxiv preprint arxiv …, 2023 - arxiv.org
Background: We are witnessing an increasing adoption of machine learning (ML), especially
deep learning (DL) algorithms in many software systems, including safety-critical systems …

PathSpotter: Exploring Tested Paths to Discover Missing Tests

A Hora - Companion Proceedings of the 32nd ACM …, 2024 - dl.acm.org
When creating test cases, ideally, developers should test both the expected and unexpected
behaviors of the program to catch more bugs and avoid regressions. However, the literature …

Automotive system testing by independent guarded assertions

T Gustafsson, M Skoglund, A Kobetski… - 2015 IEEE Eighth …, 2015 - ieeexplore.ieee.org
Testing is a key activity in industry to verify and validate products before they reach end
customers. In hardware-in-the-loop system-level verification of automotive systems, testing is …

Examining the current state of system testing methodologies in quality assurance

R Sophocleous, GM Kapitsaki - … on Agile Software Development, XP 2020 …, 2020 - Springer
Testing is an important phase of every software system, as it can reveal defects early and
contribute to achieving high software quality. In this process of quality assurance …

Offline analysis of independent guarded assertions in automotive integration testing

G Rodriguez-Navas, A Kobetski… - 2015 IEEE 17th …, 2015 - ieeexplore.ieee.org
The size and complexity of software in automotive systems have increased steadily over the
last decades. Modern vehicles typically contain numerous electrical control units (ECUs) …