Asymptotic linear expansion of regularized M-estimators

09/02/2019
by   Tino Werner, et al.
0

Parametric high-dimensional regression analysis requires the usage of regularization terms to get interpretable models. The respective estimators can be regarded as regularized M-functionals which are naturally highly nonlinear. We study under which conditions these M-functionals are compactly differentiable, so that the corresponding estimators admit an asymptotically linear expansion. In a one-step construction, for a suitably consistent starting estimator, this linearization replaces solving optimization problems by evaluating the corresponding influence curves at the given data points. We show under which conditions the asymptotic linear expansion is valid and provide concrete examples of machine learning algorithms that fit into this framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2019

First order expansion of convex regularized estimators

We consider first order expansions of convex penalized estimators in hig...
research
09/25/2020

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Consider semiparametric estimation where a doubly robust estimating func...
research
12/19/2017

Some Large Sample Results for the Method of Regularized Estimators

We present a general framework for studying regularized estimators; i.e....
research
11/26/2019

High Dimensional M-Estimation with Missing Outcomes: A Semi-Parametric Framework

We consider high dimensional M-estimation in settings where the response...
research
09/13/2018

Deterministic Inequalities for Smooth M-estimators

Ever since the proof of asymptotic normality of maximum likelihood estim...
research
12/08/2017

Scaling Limit: Exact and Tractable Analysis of Online Learning Algorithms with Applications to Regularized Regression and PCA

We present a framework for analyzing the exact dynamics of a class of on...
research
10/14/2009

L_0 regularized estimation for nonlinear models that have sparse underlying linear structures

We study the estimation of β for the nonlinear model y = f(Xβ) + ϵ when ...

Please sign up or login with your details

Forgot password? Click here to reset