Ambient-awareness in conjunction with pervasive computing is a significant challenge for
system designers. It follows the necessity of gathering raw, massive and heterogeneous …

Many real applications of bandits have sparse non-zero rewards, leading to slow learning
rates. A careful distribution modeling that utilizes problem-specific structures is known as …

In a linear stochastic bandit model, each arm corresponds to a vector in Euclidean space,
and the expected return observed at each time step is determined by an unknown linear …