Best-arm identification algorithms for multi-armed bandits in the fixed confidence setting

K Jamieson, R Nowak - 2014 48th annual conference on …, 2014 - ieeexplore.ieee.org
This paper is concerned with identifying the arm with the highest mean in a multi-armed
bandit problem using as few independent samples from the arms as possible. While the so …

Non-stochastic best arm identification and hyperparameter optimization

K Jamieson, A Talwalkar - Artificial intelligence and statistics, 2016 - proceedings.mlr.press
Motivated by the task of hyperparameter optimization, we introduce the\em non-stochastic
best-arm identification problem. We identify an attractive algorithm for this setting that makes …

Optimal best arm identification with fixed confidence

A Garivier, E Kaufmann - Conference on Learning Theory, 2016 - proceedings.mlr.press
We give a complete characterization of the complexity of best-arm identification in one-
parameter bandit problems. We prove a new, tight lower bound on the sample complexity …

[PDF][PDF] On the complexity of best-arm identification in multi-armed bandit models

E Kaufmann, O Cappé, A Garivier - The Journal of Machine Learning …, 2016 - jmlr.org
The stochastic multi-armed bandit model is a simple abstraction that has proven useful in
many different contexts in statistics and machine learning. Whereas the achievable limit in …

Almost optimal exploration in multi-armed bandits

Z Karnin, T Koren, O Somekh - International conference on …, 2013 - proceedings.mlr.press
We study the problem of exploration in stochastic Multi-Armed Bandits. Even in the simplest
setting of identifying the best arm, there remains a logarithmic multiplicative gap between the …

lil'ucb: An optimal exploration algorithm for multi-armed bandits

K Jamieson, M Malloy, R Nowak… - … on Learning Theory, 2014 - proceedings.mlr.press
The paper proposes a novel upper confidence bound (UCB) procedure for identifying the
arm with the largest mean in a multi-armed bandit game in the fixed confidence setting using …

Best arm identification: A unified approach to fixed budget and fixed confidence

V Gabillon, M Ghavamzadeh… - Advances in neural …, 2012 - proceedings.neurips.cc
We study the problem of identifying the best arm (s) in the stochastic multi-armed bandit
setting. This problem has been studied in the literature from two different perspectives: fixed …

Top two algorithms revisited

M Jourdan, R Degenne, D Baudry… - Advances in …, 2022 - proceedings.neurips.cc
Top two algorithms arose as an adaptation of Thompson sampling to best arm identification
in multi-armed bandit models for parametric families of arms. They select the next arm to …

Combinatorial pure exploration of multi-armed bandits

S Chen, T Lin, I King, MR Lyu… - Advances in neural …, 2014 - proceedings.neurips.cc
We study the {\em combinatorial pure exploration (CPE)} problem in the stochastic multi-
armed bandit setting, where a learner explores a set of arms with the objective of identifying …

An optimal algorithm for the thresholding bandit problem

A Locatelli, M Gutzeit… - … Conference on Machine …, 2016 - proceedings.mlr.press
We study a specific combinatorial pure exploration stochastic bandit problem where the
learner aims at finding the set of arms whose means are above a given threshold, up to a …