We determine the sample complexity of pure exploration bandit problems with multiple good
answers. We derive a lower bound using a new game equilibrium argument. We show how …

This paper describes sufficient conditions for the existence of optimal policies for partially
observable Markov decision processes (POMDPs) with Borel state, observation, and action …

Control barrier functions are a popular method for encoding safety specifications for
dynamical systems. In this paper, a notion of control barrier function is defined that permits …

This tutorial describes recently developed general optimality conditions for Markov decision
processes that have significant applications to inventory control. In particular, these …

Controlling antenna tilts in cellular networks is critical to achieve a good trade-off between
network coverage and capacity. We devise algorithms learning optimal tilt control policies …

This paper proves continuity of value functions in discounted periodic‐review single‐
commodity total‐cost inventory control problems with continuous inventory levels, fixed …

This paper deals with three major types of convergence of probability measures on metric
spaces: weak convergence, setwise convergence, and convergence in total variation. First, it …

Interesting posts are continually forwarded by the users of the online social network (OSN).
Such propagation leads to re-forwarding of the post to some of the previous recipients …

This paper describes the structure of optimal policies for discounted periodic-review single-
commodity total-cost inventory control problems with fixed ordering costs for finite and …

This article studies convergence properties of optimal values and actions for discounted and
average‐cost Markov decision processes (MDPs) with weakly continuous transition …