Log-Regularly Varying Scale Mixture of Normals for Robust Regression

05/06/2020
by   Yasuyuki Hamura, et al.
0

Linear regression with the classical normality assumption for the error distribution may lead to an undesirable posterior inference of regression coefficients due to the potential outliers. This paper considers the finite mixture of two components with thin and heavy tails as the error distribution, which has been routinely employed in applied statistics. For the heavily-tailed component, we introduce the novel class of distributions; their densities are log-regularly varying and have heavier tails than those of Cauchy distribution, yet they are expressed as a scale mixture of normal distributions and enable the efficient posterior inference by Gibbs sampler. We prove the robustness to outliers of the posterior distributions under the proposed models with a minimal set of assumptions, which justifies the use of shrinkage priors with unbounded densities for the high-dimensional coefficient vector in the presence of outliers. The extensive comparison with the existing methods via simulation study shows the improved performance of our model in point and interval estimation, as well as its computational efficiency. Further, we confirm the posterior robustness of our method in the empirical study with the shrinkage priors for regression coefficients.

READ FULL TEXT
research
11/21/2017

High-Dimensional Multivariate Posterior Consistency Under Global-Local Shrinkage Priors

We consider sparse Bayesian estimation in the classical multivariate lin...
research
03/01/2023

Posterior Robustness with Milder Conditions: Contamination Models Revisited

Robust Bayesian linear regression is a classical but essential statistic...
research
02/21/2021

Group Inverse-Gamma Gamma Shrinkage for Sparse Regression with Block-Correlated Predictors

Heavy-tailed continuous shrinkage priors, such as the horseshoe prior, a...
research
01/08/2018

Adaptive Bayesian Shrinkage Estimation Using Log-Scale Shrinkage Priors

Global-local shrinkage hierarchies are an important, recent innovation i...
research
09/07/2022

An extension of the Unified Skew-Normal family of distributions and application to Bayesian binary regression

We consider the general problem of Bayesian binary regression with a lar...
research
01/23/2020

Shrinkage with Robustness: Log-Adjusted Priors for Sparse Signals

We introduce a new class of distributions named log-adjusted shrinkage p...
research
08/23/2022

A flexible empirical Bayes approach to multiple linear regression and connections with penalized regression

We introduce a new empirical Bayes approach for large-scale multiple lin...

Please sign up or login with your details

Forgot password? Click here to reset