Bayesian High-dimensional Semi-parametric Inference beyond sub-Gaussian Errors

08/30/2020
by   Kyoungjae Lee, et al.
0

We consider a sparse linear regression model with unknown symmetric error under the high-dimensional setting. The true error distribution is assumed to belong to the locally β-Hölder class with an exponentially decreasing tail, which does not need to be sub-Gaussian. We obtain posterior convergence rates of the regression coefficient and the error density, which are nearly optimal and adaptive to the unknown sparsity level. Furthermore, we derive the semi-parametric Bernstein-von Mises (BvM) theorem to characterize asymptotic shape of the marginal posterior for regression coefficients. Under the sub-Gaussianity assumption on the true score function, strong model selection consistency for regression coefficients are also obtained, which eventually asserts the frequentist's validity of credible sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2020

Unified Bayesian asymptotic theory for sparse linear regression

We study frequentist asymptotic properties of Bayesian procedures for hi...
research
02/11/2022

High-dimensional properties for empirical priors in linear regression with unknown error variance

We study full Bayesian procedures for high-dimensional linear regression...
research
11/15/2018

Minimax Posterior Convergence Rates and Model Selection Consistency in High-dimensional DAG Models based on Sparse Cholesky Factors

In this paper, we study the high-dimensional sparse directed acyclic gra...
research
03/15/2021

Adaptive posterior convergence in sparse high dimensional clipped generalized linear models

We develop a framework to study posterior contraction rates in sparse hi...
research
02/03/2017

Sharp Convergence Rates for Forward Regression in High-Dimensional Sparse Linear Models

Forward regression is a statistical model selection and estimation proce...
research
07/14/2021

Performance of Bayesian linear regression in a model with mismatch

For a model of high-dimensional linear regression with random design, we...
research
10/24/2018

Posterior Convergence of Gaussian and General Stochastic Process Regression Under Possible Misspecifications

In this article, we investigate posterior convergence in nonparametric r...

Please sign up or login with your details

Forgot password? Click here to reset