Non-Standard Asymptotics in High Dimensions: Manski's Maximum Score Estimator Revisited

03/24/2019
by   Debarghya Mukherjee, et al.
0

Manski's celebrated maximum score estimator for the binary choice model has been the focus of much investigation in both the econometrics and statistics literatures, but its behavior under growing dimension scenarios still largely remains unknown. This paper seeks to address that gap. Two different cases are considered: p grows with n but at a slow rate, i.e. p/n → 0; and p ≫ n (fast growth). By relating Manski's score estimation to empirical risk minimization in a classification problem, we show that under a soft margin condition involving a smoothness parameter α > 0, the rate of the score estimator in the slow regime is essentially ((p/n) n)^α/α + 2, while, in the fast regime, the l_0 penalized score estimator essentially attains the rate ((s_0 pn)/n)^α/α + 2, where s_0 is the sparsity of the true regression parameter. For the most interesting regime, α = 1, the rates of Manski's estimator are therefore ((p/n) n)^1/3 and ((s_0 pn)/n)^1/3 in the slow and fast growth scenarios respectively, which can be viewed as high-dimensional analogues of cube-root asymptotics: indeed, this work is possibly the first study of a non-regular statistical problem in a high-dimensional framework. We also establish upper and lower bounds for the minimax L_2 error in the Manski's model that differ by a logarithmic factor, and construct a minimax-optimal estimator in the setting α=1. Finally, we provide computational recipes for the maximum score estimator in growing dimensions that show promising results.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/26/2019

Nonregular and Minimax Estimation of Individualized Thresholds in High Dimension with Binary Responses

Given a large number of covariates Z, we consider the estimation of a hi...
research
11/19/2019

Minimax rates of ℓ_p-losses for high-dimensional linear regression models with additive measurement errors over ℓ_q-balls

We study minimax rates for high-dimensional linear regression with addit...
research
04/06/2018

High-dimensional Adaptive Minimax Sparse Estimation with Interactions

High-dimensional linear regression with interaction effects is broadly a...
research
12/25/2018

Optimal False Discovery Control of Minimax Estimator

In the analysis of high dimensional regression models, there are two imp...
research
05/04/2022

Rates of estimation for high-dimensional multi-reference alignment

We study the continuous multi-reference alignment model of estimating a ...
research
12/05/2019

A Convex Optimization Approach to High-Dimensional Sparse Quadratic Discriminant Analysis

In this paper, we study high-dimensional sparse Quadratic Discriminant A...
research
10/15/2022

Distributed Estimation and Inference for Semi-parametric Binary Response Models

The development of modern technology has enabled data collection of unpr...

Please sign up or login with your details

Forgot password? Click here to reset