Minimax Risk and Uniform Convergence Rates for Nonparametric Dyadic Regression

12/15/2020
by   Bryan S. Graham, et al.
0

Let i=1,…,N index a simple random sample of units drawn from some large population. For each unit we observe the vector of regressors X_i and, for each of the N(N-1) ordered pairs of units, an outcome Y_ij. The outcomes Y_ij and Y_kl are independent if their indices are disjoint, but dependent otherwise (i.e., "dyadically dependent"). Let W_ij=(X_i',X_j')'; using the sampled data we seek to construct a nonparametric estimate of the mean regression function g(W_ij)def≡𝔼[.Y_ij|X_i,X_j]. We present two sets of results. First, we calculate lower bounds on the minimax risk for estimating the regression function at (i) a point and (ii) under the infinity norm. Second, we calculate (i) pointwise and (ii) uniform convergence rates for the dyadic analog of the familiar Nadaraya-Watson (NW) kernel regression estimator. We show that the NW kernel regression estimator achieves the optimal rates suggested by our risk bounds when an appropriate bandwidth sequence is chosen. This optimal rate differs from the one available under iid data: the effective sample size is smaller and d_W=dim(W_ij) influences the rate differently.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/17/2022

On Well-posedness and Minimax Optimal Rates of Nonparametric Q-function Estimation in Off-policy Evaluation

We study the off-policy evaluation (OPE) problem in an infinite-horizon ...
research
11/29/2022

Estimating the minimizer and the minimum value of a regression function under passive design

We propose a new method for estimating the minimizer x^* and the minimum...
research
06/27/2022

Benign overfitting and adaptive nonparametric regression

In the nonparametric regression setting, we construct an estimator which...
research
04/11/2022

Local convergence rates of the least squares estimator with applications to transfer learning

Convergence properties of empirical risk minimizers can be conveniently ...
research
12/25/2017

Uniform Rates of Convergence of Some Representations of Extremes : a first approach

Uniform convergence rates are provided for asymptotic representations of...
research
07/17/2023

Covariate shift in nonparametric regression with Markovian design

Covariate shift in regression problems and the associated distribution m...
research
02/14/2019

Optimal disclosure risk assessment

Protection against disclosure is a legal and ethical obligation for agen...

Please sign up or login with your details

Forgot password? Click here to reset