Improved convergence rates of nonparametric penalized regression under misspecified total variation

08/02/2023
by   Marlena S. Bannick, et al.
0

Penalties that induce smoothness are common in nonparametric regression. In many settings, the amount of smoothness in the data generating function will not be known. Simon and Shojaie (2021) derived convergence rates for nonparametric estimators under misspecified smoothness. We show that their theoretical convergence rates can be improved by working with convenient approximating functions. Properties of convolutions and higher-order kernels allow these approximation functions to match the true functions more closely than those used in Simon and Shojaie (2021). As a result, we obtain tighter convergence rates.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/02/2020

On optimal convergence rates of spectral orthogonal projection approximation for functions of algbraic and logarithmatic regularities

Based on the Hilb type formula between Jacobi polynomials and Bessel fun...
research
01/18/2011

Convergence rates of efficient global optimization algorithms

Efficient global optimization is the problem of minimizing an unknown fu...
research
10/04/2018

Optimal Learning with Anisotropic Gaussian SVMs

This paper investigates the nonparametric regression problem using SVMs ...
research
03/26/2020

Nonconvex sparse regularization for deep neural networks and its optimality

Recent theoretical studies proved that deep neural network (DNN) estimat...
research
05/24/2016

Convergence guarantees for kernel-based quadrature rules in misspecified settings

Kernel-based quadrature rules are becoming important in machine learning...
research
04/01/2017

Stochastic L-BFGS: Improved Convergence Rates and Practical Acceleration Strategies

We revisit the stochastic limited-memory BFGS (L-BFGS) algorithm. By pro...
research
01/08/2021

An iterative algorithm for approximating roots of integers

We explore an algorithm for approximating roots of integers, discuss its...

Please sign up or login with your details

Forgot password? Click here to reset