Free lunch for testing: Fuzzing deep-learning libraries from open source

A Wei, Y Deng, C Yang, L Zhang - Proceedings of the 44th International …, 2022 - dl.acm.org
Deep learning (DL) systems can make our life much easier, and thus are gaining more and
more attention from both academia and industry. Meanwhile, bugs in DL systems can be …

DeFlaker automatically detecting flaky tests

J Bell, O Legunsen, M Hilton, L Eloussi… - Proceedings of the 40th …, 2018 - dl.acm.org
Developers often run tests to check that their latest changes to a code repository did not
break any previously working functionality. Ideally, any new test failures would indicate …

Taming Google-scale continuous testing

A Memon, Z Gao, B Nguyen, S Dhanda… - 2017 IEEE/ACM 39th …, 2017 - ieeexplore.ieee.org
Growth in Google's code size and feature churn rate has seen increased reliance on
continuous integration (CI) and testing to maintain quality. Even with enormous resources …

iDFlakies: A framework for detecting and partially classifying flaky tests

W Lam, R Oei, A Shi, D Marinov… - 2019 12th ieee …, 2019 - ieeexplore.ieee.org
Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

Send hardest problems my way: Probabilistic path prioritization for hybrid fuzzing

L Zhao, Y Duan, J XUAN - 2019 - ink.library.smu.edu.sg
Hybrid fuzzing which combines fuzzing and concolic execution has become an advanced
technique for software vulnerability detection. Based on the observation that fuzzing and …

Learning-to-rank vs ranking-to-learn: Strategies for regression testing in continuous integration

A Bertolino, A Guerriero, B Miranda… - Proceedings of the …, 2020 - dl.acm.org
In Continuous Integration (CI), regression testing is constrained by the time between
commits. This demands for careful selection and/or prioritization of test cases within test …

Hybrid regression test selection

L Zhang - Proceedings of the 40th International Conference on …, 2018 - dl.acm.org
Regression testing is crucial but can be extremely costly. Regression Test Selection (RTS)
aims to reduce regression testing cost by only selecting and running the tests that may be …

Predictive test selection

M Machalica, A Samylkin, M Porth… - 2019 IEEE/ACM 41st …, 2019 - ieeexplore.ieee.org
Change-based testing is a key component of continuous integration at Facebook. However,
a large number of tests coupled with a high rate of changes committed to our monolithic …

Practical accuracy estimation for efficient deep neural network testing

J Chen, Z Wu, Z Wang, H You, L Zhang… - ACM Transactions on …, 2020 - dl.acm.org
Deep neural network (DNN) has become increasingly popular and DNN testing is very
critical to guarantee the correctness of DNN, ie, the accuracy of DNN in this work. However …

Empirically evaluating readily available information for regression test optimization in continuous integration

D Elsner, F Hauer, A Pretschner, S Reimer - Proceedings of the 30th …, 2021 - dl.acm.org
Regression test selection (RTS) and prioritization (RTP) techniques aim to reduce testing
efforts and developer feedback time after a change to the code base. Using various …