Minimax Optimal Rates of Estimation in High Dimensional Additive Models: Universal Phase Transition

03/10/2015
by   Ming Yuan, et al.
0

We establish minimax optimal rates of convergence for estimation in a high dimensional additive model assuming that it is approximately sparse. Our results reveal an interesting phase transition behavior universal to this class of high dimensional problems. In the sparse regime when the components are sufficiently smooth or the dimensionality is sufficiently large, the optimal rates are identical to those for high dimensional linear regression, and therefore there is no additional cost to entertain a nonparametric model. Otherwise, in the so-called smooth regime, the rates coincide with the optimal rates for estimating a univariate function, and therefore they are immune to the "curse of dimensionality".

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2019

Minimax rates of ℓ_p-losses for high-dimensional linear regression models with additive measurement errors over ℓ_q-balls

We study minimax rates for high-dimensional linear regression with addit...
research
07/23/2019

Minimax rates in sparse, high-dimensional changepoint detection

We study the detection of a sparse change in a high-dimensional mean vec...
research
07/13/2021

Convergence rates of vector-valued local polynomial regression

Non-parametric estimation of functions as well as their derivatives by m...
research
09/16/2022

Nonparametric Estimation via Mixed Gradients

Traditional nonparametric estimation methods often lead to a slow conver...
research
06/01/2023

From sparse to dense functional data in high dimensions: Revisiting phase transitions from a non-asymptotic perspective

Nonparametric estimation of the mean and covariance functions is ubiquit...
research
06/13/2020

Optimal Rates for Estimation of Two-Dimensional Totally Positive Distributions

We study minimax estimation of two-dimensional totally positive distribu...
research
06/18/2012

Sparse Additive Functional and Kernel CCA

Canonical Correlation Analysis (CCA) is a classical tool for finding cor...

Please sign up or login with your details

Forgot password? Click here to reset