Variational Bayes for Gaussian Factor Models under the Cumulative Shrinkage Process

08/12/2020
by   Sirio Legramanti, et al.
0

The cumulative shrinkage process is an increasing shrinkage prior that can be employed within models in which additional terms are supposed to play a progressively negligible role. A natural application is to Gaussian factor models, where such a process has proved effective in inducing parsimonious representations while providing accurate inference on the data covariance matrix. The cumulative shrinkage process came with an adaptive Gibbs sampler that tunes the number of latent factors throughout iterations, which makes it faster than the non-adaptive Gibbs sampler. In this work we propose a variational algorithm for Gaussian factor models endowed with a cumulative shrinkage process. Such a strategy provides comparable inference with respect to the adaptive Gibbs sampler and further reduces runtime

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/12/2019

Bayesian cumulative shrinkage for infinite factorizations

There are a variety of Bayesian models relying on representations in whi...
research
08/16/2022

Structured prior distributions for the covariance matrix in latent factor models

Factor models are widely used for dimension reduction in the analysis of...
research
01/27/2018

Adaptive Scan Gibbs Sampler for Large Scale Inference Problems

For large scale on-line inference problems the update strategy is critic...
research
03/01/2023

Generalized Cumulative Shrinkage Process Priors with Applications to Sparse Bayesian Factor Analysis

The paper discusses shrinkage priors which impose increasing shrinkage i...
research
11/15/2021

Amended Gibbs samplers for Cosmic Microwave Background power spectrum estimation

We study different variants of the Gibbs sampler algorithm from the pers...
research
02/17/2023

The Shrinkage-Delinkage Trade-off: An Analysis of Factorized Gaussian Approximations for Variational Inference

When factorized approximations are used for variational inference (VI), ...
research
04/03/2020

Relaxing the Gaussian assumption in Shrinkage and SURE in high dimension

Shrinkage estimation is a fundamental tool of modern statistics, pioneer...

Please sign up or login with your details

Forgot password? Click here to reset