Approximating posteriors with high-dimensional nuisance parameters via integrated rotated Gaussian approximation

09/15/2019
by   Willem van den Boom, et al.
0

Posterior computation for high-dimensional data with many parameters can be challenging. This article focuses on a new method for approximating posterior distributions of a low- to moderate-dimensional parameter in the presence of a high-dimensional or otherwise computationally challenging nuisance parameter. The focus is on regression models and the key idea is to separate the likelihood into two components through a rotation. One component involves only the nuisance parameters, which can then be integrated out using a novel type of Gaussian approximation. We provide theory on approximation accuracy that holds for a broad class of forms of the nuisance component and priors. Applying our method to simulated and real data sets shows that it can outperform state-of-the-art posterior approximation approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/15/2019

Scalable and Accurate Variational Bayes for High-Dimensional Binary Regression Models

State-of-the-art methods for Bayesian inference on regression models wit...
research
11/15/2019

Asymptotically Exact Variational Bayes for High-Dimensional Binary Regression Models

State-of-the-art methods for Bayesian inference on regression models wit...
research
11/06/2018

Fast High-Dimensional Bilateral and Nonlocal Means Filtering

Existing fast algorithms for bilateral and nonlocal means filtering most...
research
09/05/2022

On free energy barriers in Gaussian priors and failure of MCMC for high-dimensional unimodal distributions

We exhibit examples of high-dimensional unimodal posterior distributions...
research
02/26/2019

Human-in-the-loop Active Covariance Learning for Improving Prediction in Small Data Sets

Learning predictive models from small high-dimensional data sets is a ke...
research
04/29/2021

Loss-Based Variational Bayes Prediction

We propose a new method for Bayesian prediction that caters for models w...
research
04/15/2018

From CDF to PDF --- A Density Estimation Method for High Dimensional Data

CDF2PDF is a method of PDF estimation by approximating CDF. The original...

Please sign up or login with your details

Forgot password? Click here to reset