Bayesian Shrinkage towards Sharp Minimaxity

04/11/2020
by   Qifan Song, et al.
0

Shrinkage prior are becoming more and more popular in Bayesian modeling for high dimensional sparse problems due to its computational efficiency. Recent works show that a polynomially decaying prior leads to satisfactory posterior asymptotics under regression models. In the literature, statisticians have investigated how the global shrinkage parameter, i.e., the scale parameter, in a heavy tail prior affects the posterior contraction. In this work, we explore how the shape of the prior, or more specifically, the polynomial order of the prior tail affects the posterior. We discover that, under the sparse normal means models, the polynomial order does affect the multiplicative constant of the posterior contraction rate. More importantly, if the polynomial order is sufficiently close to 1, it will induce the optimal Bayesian posterior convergence, in the sense that the Bayesian contraction rate is sharply minimax, i.e., not only the order, but also the multiplicative constant of the posterior contraction rate are optimal. The above Bayesian sharp minimaxity holds when the global shrinkage parameter follows a deterministic choice which depends on the unknown sparsity s. Therefore, a Beta-prior modeling is further proposed, such that our sharply minimax Bayesian procedure is adaptive to unknown s. Our theoretical discoveries are justified by simulation studies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/09/2019

Ultra High-dimensional Multivariate Posterior Contraction Rate Under Shrinkage Priors

In recent years, shrinkage priors have received much attention in high-d...
research
12/26/2020

Graph signal denoising using t-shrinkage priors

We study the graph signal denoising problem by estimating a piecewise co...
research
07/17/2018

On the Beta Prime Prior for Scale Parameters in High-Dimensional Bayesian Regression Models

We study high-dimensional Bayesian linear regression with a general beta...
research
12/24/2017

Nearly optimal Bayesian Shrinkage for High Dimensional Regression

During the past decade, shrinkage priors have received much attention in...
research
06/26/2022

Scalable and optimal Bayesian inference for sparse covariance matrices via screened beta-mixture prior

In this paper, we propose a scalable Bayesian method for sparse covarian...
research
07/04/2020

Continuous shrinkage prior revisited: a collapsing behavior and remedy

Modern genomic studies are increasingly focused on identifying more and ...
research
01/23/2020

Shrinkage with Robustness: Log-Adjusted Priors for Sparse Signals

We introduce a new class of distributions named log-adjusted shrinkage p...

Please sign up or login with your details

Forgot password? Click here to reset