Essays on semiparametric estimation of Markov decision processes
Dynamic models of forward looking agents, whose goal is to maximize expected in-tertemporal payoffs, are useful modelling frameworks in economics. With an exception of a small class of dynamic decision processes, the estimation of the primitives in these models is computationally burdensome due to t...
Main Author: | |
---|---|
Published: |
London School of Economics and Political Science (University of London)
2010
|
Subjects: | |
Online Access: | http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.518778 |
id |
ndltd-bl.uk-oai-ethos.bl.uk-518778 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-bl.uk-oai-ethos.bl.uk-5187782015-09-03T03:16:01ZEssays on semiparametric estimation of Markov decision processesSrisuma, Sorawoot2010Dynamic models of forward looking agents, whose goal is to maximize expected in-tertemporal payoffs, are useful modelling frameworks in economics. With an exception of a small class of dynamic decision processes, the estimation of the primitives in these models is computationally burdensome due to the presence of the value functions that has no closed form. We follow a popular two-step approach which estimates the functions of interest rather than use direct numerical approximation. The first chapter, joint with Oliver Linton, considers a class of dynamic discrete choice models that contain observable continuously distributed state variables. Most papers on the estimation of dynamic discrete choice models assume that the observable state variables can only take finitely many values. We show that the extension to the infinite dimensional case leads to a well-posed inverse problem. We derive the distribution theory for the finite and the infinite dimensional parameters. Dynamic models with continuous choice can sometimes avoid the numerical issues related to the value function through the use of Euler's equation. The second chapter considers models with continuous choice that do not necessarily belong to the Euler class but frequently arise in applied problems. In this chapter, a class of minimum distance estimators is proposed, their distribution theory along with the infinite dimensional parameters of the decision models are derived. The third chapter demonstrates how the methodology developed for the discrete and continuous choice problems can be adapted to estimate a variety of other dynamic models. The final chapter discusses an important problem, and provides an example, where some well-known estimation procedures in the literature may fail to consistently estimate an identified model. The estimation methodologies I propose in the preceding chapters may not suffer from the problems of this kind.519.2London School of Economics and Political Science (University of London)http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.518778http://etheses.lse.ac.uk/2371/Electronic Thesis or Dissertation |
collection |
NDLTD |
sources |
NDLTD |
topic |
519.2 |
spellingShingle |
519.2 Srisuma, Sorawoot Essays on semiparametric estimation of Markov decision processes |
description |
Dynamic models of forward looking agents, whose goal is to maximize expected in-tertemporal payoffs, are useful modelling frameworks in economics. With an exception of a small class of dynamic decision processes, the estimation of the primitives in these models is computationally burdensome due to the presence of the value functions that has no closed form. We follow a popular two-step approach which estimates the functions of interest rather than use direct numerical approximation. The first chapter, joint with Oliver Linton, considers a class of dynamic discrete choice models that contain observable continuously distributed state variables. Most papers on the estimation of dynamic discrete choice models assume that the observable state variables can only take finitely many values. We show that the extension to the infinite dimensional case leads to a well-posed inverse problem. We derive the distribution theory for the finite and the infinite dimensional parameters. Dynamic models with continuous choice can sometimes avoid the numerical issues related to the value function through the use of Euler's equation. The second chapter considers models with continuous choice that do not necessarily belong to the Euler class but frequently arise in applied problems. In this chapter, a class of minimum distance estimators is proposed, their distribution theory along with the infinite dimensional parameters of the decision models are derived. The third chapter demonstrates how the methodology developed for the discrete and continuous choice problems can be adapted to estimate a variety of other dynamic models. The final chapter discusses an important problem, and provides an example, where some well-known estimation procedures in the literature may fail to consistently estimate an identified model. The estimation methodologies I propose in the preceding chapters may not suffer from the problems of this kind. |
author |
Srisuma, Sorawoot |
author_facet |
Srisuma, Sorawoot |
author_sort |
Srisuma, Sorawoot |
title |
Essays on semiparametric estimation of Markov decision processes |
title_short |
Essays on semiparametric estimation of Markov decision processes |
title_full |
Essays on semiparametric estimation of Markov decision processes |
title_fullStr |
Essays on semiparametric estimation of Markov decision processes |
title_full_unstemmed |
Essays on semiparametric estimation of Markov decision processes |
title_sort |
essays on semiparametric estimation of markov decision processes |
publisher |
London School of Economics and Political Science (University of London) |
publishDate |
2010 |
url |
http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.518778 |
work_keys_str_mv |
AT srisumasorawoot essaysonsemiparametricestimationofmarkovdecisionprocesses |
_version_ |
1716818068877869056 |