The Illusion of the Illusion of Sparsity: An exercise in prior sensitivity

09/29/2020
by   Bruno Fava, et al.
0

The emergence of Big Data raises the question of how to model economic relations when there is a large number of possible explanatory variables. We revisit the issue by comparing the possibility of using dense or sparse models in a Bayesian approach, allowing for variable selection and shrinkage. More specifically, we discuss the results reached by Giannone, Lenza, and Primiceri (2020) through a "Spike-and-Slab" prior, which suggest an "illusion of sparsity" in economic data, as no clear patterns of sparsity could be detected. We make a further revision of the posterior distributions of the model, and propose three experiments to evaluate the robustness of the adopted prior distribution. We find that the pattern of sparsity is sensitive to the prior distribution of the regression coefficients, and present evidence that the model indirectly induces variable selection and shrinkage, which suggests that the "illusion of sparsity" could be, itself, an illusion. Code is available on github.com/bfava/IllusionOfIllusion.

READ FULL TEXT

page 23

page 27

page 29

page 30

page 32

research
09/29/2020

Dynamic sparsity on dynamic regression models

In the present work, we consider variable selection and shrinkage for th...
research
04/25/2019

Bayesian Variable Selection for Multi-Outcome Models Through Shared Shrinkage

Variable selection over a potentially large set of covariates in a linea...
research
10/11/2020

The Knowledge Graph for Macroeconomic Analysis with Alternative Big Data

The current knowledge system of macroeconomics is built on interactions ...
research
04/28/2022

A robust Bayesian analysis of variable selection under prior ignorance

We propose a cautious Bayesian variable selection routine by investigati...
research
01/09/2018

On variance estimation for Bayesian variable selection

Consider the problem of high dimensional variable selection for the Gaus...
research
07/30/2020

Ultrahigh dimensional instrument detection using graph learning: an application to high dimensional GIS-census data for house pricing

The exogeneity bias and instrument validation have always been critical ...
research
03/04/2022

Sparsity-Inducing Categorical Prior Improves Robustness of the Information Bottleneck

The information bottleneck framework provides a systematic approach to l...

Please sign up or login with your details

Forgot password? Click here to reset