Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior

10/01/2018
by   Chang Liu, et al.
0

In the context of a high-dimensional linear regression model, we propose the use of an empirical correlation-adaptive prior that makes use of information in the observed predictor variable matrix to adaptively address high collinearity, determining if parameters associated with correlated predictors should be shrunk together or kept apart. Under suitable conditions, we prove that this empirical Bayes posterior concentrates around the true sparse parameter at the optimal rate asymptotically. A simplified version of a shotgun stochastic search algorithm is employed to implement the variable selection procedure, and we show, via simulation experiments across different settings and a real-data application, the favorable performance of the proposed method compared to existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2023

Empirical Bayes inference in sparse high-dimensional generalized linear models

High-dimensional linear models have been extensively studied in the rece...
research
01/10/2019

Bayesian variable selection in linear regression models with instrumental variables

Many papers on high-dimensional statistics have proposed methods for var...
research
04/17/2019

High-dimensional variable selection via low-dimensional adaptive learning

A stochastic search method, the so-called Adaptive Subspace (AdaSub) met...
research
12/11/2017

Asymptotically optimal empirical Bayes inference in a piecewise constant sequence model

Inference on high-dimensional parameters in structured linear models is ...
research
09/16/2022

Sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm

Bayesian variable selection methods are powerful techniques for fitting ...
research
09/15/2023

Heteroscedastic sparse high-dimensional linear regression with a partitioned empirical Bayes ECM algorithm

Sparse linear regression methods for high-dimensional data often assume ...
research
10/06/2019

Predicting Phenotypes from Brain Connection Structure

This article focuses on the problem of predicting a response variable ba...

Please sign up or login with your details

Forgot password? Click here to reset