Statistical challenges in online controlled experiments: A review of a/b testing methodology

N Larsen, J Stallrich, S Sengupta, A Deng… - The American …, 2024 - Taylor & Francis
The rise of internet-based services and products in the late 1990s brought about an
unprecedented opportunity for online businesses to engage in large scale data-driven …

A/B testing in network data with covariate-adaptive randomization

J Wang, P Li, F Hu - International Conference on Machine …, 2023 - proceedings.mlr.press
Users linked together through a network often tend to have similar behaviors. This
phenomenon is usually known as network interaction. Users' characteristics, the covariates …

Optimized covariance design for ab test on social network under interference

Q Chen, B Li, L Deng, Y Wang - Advances in Neural …, 2023 - proceedings.neurips.cc
Online A/B tests have become increasingly popular and important for social platforms.
However, accurately estimating the global average treatment effect (GATE) has proven to be …

Collaborative Analysis for Paired A/B Testing Experiments

Q Zhang, L Kang, X Deng - arxiv preprint arxiv:2407.05400, 2024 - arxiv.org
With the extensive use of digital devices, online experimental platforms are commonly used
to conduct experiments to collect data for evaluating different variations of products …

Collaborative Design of Controlled Experiments in the Presence of Subject Covariates

W Fisher, Q Zhang, L Kang, X Deng - arxiv preprint arxiv:2412.10213, 2024 - arxiv.org
We consider the optimal experimental design problem of allocating subjects to treatment or
control when subjects participate in multiple, separate controlled experiments within a short …

[HTML][HTML] MODE: Minimax Optimal Deterministic Experiments for Causal Inference in the Presence of Covariates

S Xu, S Liu, Y Zhou - Entropy, 2024 - pmc.ncbi.nlm.nih.gov
Data-driven decision-making has become crucial across various domains. Randomization
and re-randomization are standard techniques employed in controlled experiments to …

Clustering-Based Imputation for Dropout Buyers in Large-Scale Online Experimentation

S Shen, H Mao, Z Zhang, Z Chen, K Nie… - arxiv preprint arxiv …, 2022 - arxiv.org
In online experimentation, appropriate metrics (eg, purchase) provide strong evidence to
support hypotheses and enhance the decision-making process. However, incomplete …

On the Asymptotics of Graph Cut Objectives for Experimental Designs of Network A/B Testing

Q Zhang - arxiv preprint arxiv:2309.08797, 2023 - arxiv.org
A/B testing is an effective way to assess the potential impacts of two treatments. For A/B tests
conducted by IT companies, the test users of A/B testing are often connected and form a …

Design and Analysis of Experiments on Networks

T Bui - 2024 - uwspace.uwaterloo.ca
In the design and analysis of experiments, it is often assumed that experimental units are
independent, in the sense that the treatment assigned to one unit will not affect the potential …

[КНИГА][B] Covariate-Adaptive Randomization in Network Data

J Wang - 2023 - search.proquest.com
Users linked together through a network often tend to have similar behaviors. This
phenomenon is usually known as network interactions, which can be demonstrated by the …