Asymptotic Properties of Penalized Spline Estimators in Concave Extended Linear Models: Rates of Convergence

05/13/2021
by   Jianhua Z. Huang, et al.
0

This paper develops a general theory on rates of convergence of penalized spline estimators for function estimation when the likelihood functional is concave in candidate functions, where the likelihood is interpreted in a broad sense that includes conditional likelihood, quasi-likelihood, and pseudo-likelihood. The theory allows all feasible combinations of the spline degree, the penalty order, and the smoothness of the unknown functions. According to this theory, the asymptotic behaviors of the penalized spline estimators depends on interplay between the spline knot number and the penalty parameter. The general theory is applied to obtain results in a variety of contexts, including regression, generalized regression such as logistic regression and Poisson regression, density estimation, conditional hazard function estimation for censored data, quantile regression, diffusion function estimation for a diffusion type process, and estimation of spectral density function of a stationary time series. For multi-dimensional function estimation, the theory (presented in the Supplementary Material) covers both penalized tensor product splines and penalized bivariate splines on triangulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/23/2022

Naive Penalized Spline Estimators of Derivatives Achieve Optimal Rates of Convergence

This paper studies the asymptotic behavior of penalized spline estimates...
research
06/20/2019

M-type penalized splines with auxiliary scale estimation

Penalized spline smoothing is a popular and flexible method of obtaining...
research
01/28/2022

Asymptotic behaviour of penalized robust estimators in logistic regression when dimension increases

Penalized M-estimators for logistic regression models have been previous...
research
01/10/2019

Smoothing Spline Semiparametric Density Models

Density estimation plays a fundamental role in many areas of statistics ...
research
11/12/2020

Gaussian Transforms Modeling and the Estimation of Distributional Regression Functions

Conditional distribution functions are important statistical objects for...
research
03/11/2018

Piecewise Convex Function Estimation: Representations, Duality and Model Selection

We consider spline estimates which preserve prescribed piecewise convex ...
research
09/09/2021

Posterior Concentration Rates for Bayesian O'Sullivan Penalized Splines

The O'Sullivan penalized splines approach is a popular frequentist appro...

Please sign up or login with your details

Forgot password? Click here to reset