[HTML][HTML] A/B testing: A systematic literature review

F Quin, D Weyns, M Galster, CC Silva - Journal of Systems and Software, 2024 - Elsevier
A/B testing, also referred to as online controlled experimentation or continuous
experimentation, is a form of hypothesis testing where two variants of a piece of software are …

Statistical challenges in online controlled experiments: A review of a/b testing methodology

N Larsen, J Stallrich, S Sengupta, A Deng… - The American …, 2024 - Taylor & Francis
The rise of internet-based services and products in the late 1990s brought about an
unprecedented opportunity for online businesses to engage in large scale data-driven …

Top challenges from the first practical online controlled experiments summit

S Gupta, R Kohavi, D Tang, Y Xu, R Andersen… - ACM SIGKDD …, 2019 - dl.acm.org
Online controlled experiments (OCEs), also known as A/B tests, have become ubiquitous in
evaluating the impact of changes made to software products and services. While the concept …

[HTML][HTML] Controlled experimentation in continuous experimentation: Knowledge and challenges

F Auer, R Ros, L Kaltenbrunner, P Runeson… - Information and …, 2021 - Elsevier
Context: Continuous experimentation and A/B testing is an established industry practice that
has been researched for more than 10 years. Our aim is to synthesize the conducted …

Optimal Baseline Corrections for Off-Policy Contextual Bandits

S Gupta, O Jeunen, H Oosterhuis… - Proceedings of the 18th …, 2024 - dl.acm.org
The off-policy learning paradigm allows for recommender systems and general ranking
applications to be framed as decision-making problems, where we aim to learn decision …

[HTML][HTML] Heat dissipation analysis and multi-objective optimization of a permanent magnet synchronous motor using surrogate assisted method

Y Li, C Li, A Garg, L Gao, W Li - Case Studies in Thermal Engineering, 2021 - Elsevier
Permanent magnet synchronous motors (PMSM) have been substantially used in electric
vehicles (EVs) due to their advantages such as low loss, large torque, and high power …

Learning Metrics that Maximise Power for Accelerated A/B-Tests

O Jeunen, A Ustimenko - Proceedings of the 30th ACM SIGKDD …, 2024 - dl.acm.org
Online controlled experiments are a crucial tool to allow for confident decision-making in
technology companies. A North Star metric is defined (such as long-term revenue or user …

Using machine learning for efficient flexible regression adjustment in economic experiments

JA List, I Muir, G Sun - Econometric Reviews, 2024 - Taylor & Francis
This study investigates the optimal use of covariates in reducing variance when analyzing
experimental data. We show that finding the variance-minimizing strategy for making use of …

Multi-Objective Recommendation via Multivariate Policy Learning

O Jeunen, J Mandav, I Potapov, N Agarwal… - Proceedings of the 18th …, 2024 - dl.acm.org
Real-world recommender systems often need to balance multiple objectives when deciding
which recommendations to present to users. These include behavioural signals (eg clicks …

Systematic look at machine learning algorithms–advantages, disadvantages and practical applications

K Dineva, T Atanasova - … Scientific GeoConference: SGEM, 2020 - search.proquest.com
Abstract Machine Learning (ML) is the study and the usage of the mathematical algorithms
which can improve their performance without the need for human interaction. These …