Structural estimation of Markov decision processes

J Rust - Handbook of econometrics, 1994 - Elsevier
Publisher Summary This chapter summarizes the ability of the models to track the shift in
departure rates induced by the 1982 window plan. All forecasts were based on the …

Econometric tools for analyzing market outcomes

D Ackerberg, CL Benkard, S Berry, A Pakes - Handbook of econometrics, 2007 - Elsevier
This paper outlines recently developed techniques for estimating the primitives needed to
empirically analyze equilibrium interactions and their implications in oligopolistic markets. It …

Reinforcement learning with human feedback: Learning dynamic choices via pessimism

Z Li, Z Yang, M Wang - arxiv preprint arxiv:2305.18438, 2023 - arxiv.org
In this paper, we study offline Reinforcement Learning with Human Feedback (RLHF) where
we aim to learn the human's underlying reward and the MDP's optimal policy from a set of …

[КНИГА][B] Discrete choice methods with simulation

KE Train - 2009 - books.google.com
This book describes the new generation of discrete choice methods, focusing on the many
advances that are made possible by simulation. Researchers use these statistical methods …

Estimating dynamic models of imperfect competition

P Bajari, CL Benkard, J Levin - Econometrica, 2007 - Wiley Online Library
We describe a two‐step algorithm for estimating dynamic games under the assumption that
behavior is consistent with Markov perfect equilibrium. In the first step, the policy functions …

Modeling college major choices using elicited measures of expectations and counterfactuals

P Arcidiacono, VJ Hotz, S Kang - Journal of Econometrics, 2012 - Elsevier
The choice of a college major plays a critical role in determining the future earnings of
college graduates. Students make their college major decisions in part due to the future …

Demand analysis using strategic reports: An application to a school choice mechanism

N Agarwal, P Somaini - Econometrica, 2018 - Wiley Online Library
Several school districts use assignment systems that give students an incentive to
misrepresent their preferences. We find evidence consistent with strategic behavior in …

The costs of environmental regulation in a concentrated industry

SP Ryan - Econometrica, 2012 - Wiley Online Library
The typical cost analysis of an environmental regulation consists of an engineering estimate
of the compliance costs. In industries where fixed costs are an important determinant of …

Sequential estimation of dynamic discrete games

V Aguirregabiria, P Mira - Econometrica, 2007 - Wiley Online Library
This paper studies the estimation of dynamic discrete games of incomplete information. Two
main econometric issues appear in the estimation of these models: the indeterminacy …

Conditional choice probability estimation of dynamic discrete choice models with unobserved heterogeneity

P Arcidiacono, RA Miller - Econometrica, 2011 - Wiley Online Library
We adapt the expectation–maximization algorithm to incorporate unobserved heterogeneity
into conditional choice probability (CCP) estimators of dynamic discrete choice problems …