Inference on weighted average value function in high-dimensional state space

08/24/2019
by   Victor Chernozhukov, et al.
22

This paper gives a consistent, asymptotically normal estimator of the expected value function when the state space is high-dimensional and the first-stage nuisance functions are estimated by modern machine learning tools. First, we show that value function is orthogonal to the conditional choice probability, therefore, this nuisance function needs to be estimated only at n^-1/4 rate. Second, we give a correction term for the transition density of the state variable. The resulting orthogonal moment is robust to misspecification of the transition density and does not require this nuisance function to be consistently estimated. Third, we generalize this result by considering the weighted expected value. In this case, the orthogonal moment is doubly robust in the transition density and additional second-stage nuisance functions entering the correction term. We complete the asymptotic theory by providing bounds on second-order asymptotic terms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/29/2023

Asymptotic Inference for Multi-Stage Stationary Treatment Policy with High Dimensional Features

Dynamic treatment rules or policies are a sequence of decision functions...
research
11/01/2017

Orthogonal Machine Learning: Power and Limitations

Double machine learning provides √(n)-consistent estimates of parameters...
research
06/13/2018

Plug-in Regularized Estimation of High-Dimensional Parameters in Nonlinear Semiparametric Models

We develop a theory for estimation of a high-dimensional sparse paramete...
research
05/23/2019

Recurrent Value Functions

Despite recent successes in Reinforcement Learning, value-based methods ...
research
04/07/2021

Minimax Kernel Machine Learning for a Class of Doubly Robust Functionals

A moment function is called doubly robust if it is comprised of two nuis...
research
02/24/2022

Threading the Needle of On and Off-Manifold Value Functions for Shapley Explanations

A popular explainable AI (XAI) approach to quantify feature importance o...
research
09/18/2020

Low-rank MDP Approximation via Moment Coupling

We propose a novel method—based on local moment matching—to approximate ...

Please sign up or login with your details

Forgot password? Click here to reset