[HTML][HTML] Controlled experimentation in continuous experimentation: Knowledge and challenges

F Auer, R Ros, L Kaltenbrunner, P Runeson… - Information and …, 2021 - Elsevier
Context: Continuous experimentation and A/B testing is an established industry practice that
has been researched for more than 10 years. Our aim is to synthesize the conducted …

Continuous experiment definition characteristics

F Auer, CS Lee, M Felderer - 2020 46th Euromicro Conference …, 2020 - ieeexplore.ieee.org
The definition of an experiment is a fundamental artifact of continuous experiments. It is used
to formalize ideas as a plan of action and to document attained knowledge. Although there is …

Comparison of multi-criteria decision-making methods for online controlled experiments in a launch decision-making framework

JJW Wu, TA Mazzuchi, S Sarkani - Information and Software Technology, 2023 - Elsevier
Context User-intensive software systems such as Web and mobile applications are defined
as systems that serve and interact with an increasingly large number of users. Inefficient …

A Literature Study to Characterize Continuous Experimentation in Software Engineering

VM Erthal, P Bruno, PSM dos Santos… - Anais do XXV …, 2022 - sol.sbc.org.br
Continuous Experimentation (CE) has become increasingly popular across industry and
academic communities. Given its rapid evolution in software engineering (SE), the lack of a …

The HURRIER process for experimentation in business‐to‐business mission‐critical systems

D Issa Mattos, A Dakkak, J Bosch… - Journal of Software …, 2023 - Wiley Online Library
Continuous experimentation (CE) refers to a set of practices used by software companies to
rapidly assess the usage, value, and performance of deployed software using data collected …

[HTML][HTML] Undulate: A framework for data-driven software engineering enabling soft computing

T Asikainen, T Männistö - Information and Software Technology, 2022 - Elsevier
Context. Especially web-facing software systems enable the collection of usage data at a
massive scale. At the same time, the scale and scope of software processes have grown …

Multi-armed bandits in the wild: Pitfalls and strategies in online experiments

DI Mattos, J Bosch, HH Olsson - Information and Software Technology, 2019 - Elsevier
Context Delivering faster value to customers with online experimentation is an emerging
practice in industry. Multi-Armed Bandit (MAB) based experiments have the potential to …

Automotive A/B testing: Challenges and lessons learned from practice

DI Mattos, J Bosch, HH Olsson… - 2020 46th Euromicro …, 2020 - ieeexplore.ieee.org
Over the past 15 years, A/B testing has been a critical tool for accurate prioritization of
development efforts in online and web-facing companies. As automotive companies …

Data driven development: Challenges in online, embedded and on-premise software

H Holmström Olsson, J Bosch - … 2019, Barcelona, Spain, November 27–29 …, 2019 - Springer
For more than a decade, data driven development has attracted attention as one of the most
powerful means to improve effectiveness and ensure value delivery to customers. In online …

Characterization of continuous experimentation in software engineering: Expressions, models, and strategies

VM Erthal, BP de Souza, PSM dos Santos… - Science of Computer …, 2023 - Elsevier
Abstract Context Continuous Experimentation (CE) has become increasingly popular across
industry and academic communities. Major software organizations use CE to increase their …