Monte carlo gradient estimation in machine learning

S Mohamed, M Rosca, M Figurnov, A Mnih - Journal of Machine Learning …, 2020 - jmlr.org
This paper is a broad and accessible survey of the methods we have at our disposal for
Monte Carlo gradient estimation in machine learning and across the statistical sciences: the …

[KÖNYV][B] Stochastic gradient estimation

MC Fu - 2015 - Springer
This chapter reviews simulation-based methods for estimating gradients, which are central
to gradient-based simulation optimization algorithms such as stochastic approximation and …

Automatic differentiation of programs with discrete randomness

G Arya, M Schauer, F Schäfer… - Advances in Neural …, 2022 - proceedings.neurips.cc
Automatic differentiation (AD), a technique for constructing new programs which compute
the derivative of an original program, has become ubiquitous throughout scientific …

[KÖNYV][B] Design and analysis of simulation experiments

JPC Kleijnen - 2018 - Springer
This contribution summarizes the design and analysis of experiments with computerized
simulation models. It focuses on two metamodel (surrogate, emulator) types, namely first …

Gradient estimation for discrete-event systems by measure-valued differentiation

B Heidergott, FJ Vázquez--Abad, G Pflug… - ACM Transactions on …, 2010 - dl.acm.org
In simulation of complex stochastic systems, such as Discrete-Event Systems (DES),
statistical distributions are used to model the underlying randomness in the system. A …

On the variance of single-run unbiased stochastic derivative estimators

Z Cui, MC Fu, JQ Hu, Y Liu, Y Peng… - INFORMS Journal on …, 2020 - pubsonline.informs.org
We analyze the variance of single-run unbiased stochastic derivative estimators. The
distribution of a specific conditional expectation characterizes an intrinsic distributional …

A measure-valued differentiation approach to sensitivities of quantiles

B Heidergott… - Mathematics of Operations …, 2016 - pubsonline.informs.org
Quantiles play an important role in modelling quality of service in the service industry and in
modelling risk in the financial industry. The recent discovery that efficient simulation-based …

Weak differentiability of product measures

B Heidergott, H Leahu - Mathematics of Operations …, 2010 - pubsonline.informs.org
In this paper, we study cost functions over a finite collection of random variables. For these
types of models, a calculus of differentiation is developed that allows us to obtain a closed …

On comparison of steady-state infinitesimal perturbation analysis and likelihood ratio derivative estimates

JQ Hu, T Lian - Discrete Event Dynamic Systems, 2023 - Springer
In this paper, we compare the infinitesimal perturbation analysis (IPA) and likelihood ratio
(LR) derivative estimators for the steady-state system time of the M/M/1 queue. We derive the …

Monte Carlo computation in finance

J Staum - Monte Carlo and Quasi-Monte Carlo Methods 2008, 2009 - Springer
This advanced tutorial aims at an exposition of problems in finance that are worthy of study
by the Monte Carlo research community. It describes problems in valuing and hedging …