On the identifiability of Bayesian factor analytic models

04/10/2020
by   Panagiotis Papastamoulis, et al.
0

A well known identifiability issue in factor analytic models is the invariance with respect to orthogonal transformations. This problem burdens the inference under a Bayesian setup, where Markov chain Monte Carlo (MCMC) methods are used to generate samples from the posterior distribution. We introduce a post-processing scheme in order to deal with rotation, sign and permutation invariance of the MCMC sample. The exact version of the contributed algorithm requires to solve 2^q assignment problems per (retained) MCMC iteration, where q denotes the number of factors of the fitted model. For large numbers of factors two approximate schemes based on simulated annealing are also discussed. We demonstrate that the proposed method leads to interpretable posterior distributions using synthetic and publicly available data from typical factor analytic models as well as mixtures of factor analyzers. An R package is available online at CRAN web-page.

READ FULL TEXT

page 8

page 11

page 32

research
03/22/2014

Firefly Monte Carlo: Exact MCMC with Subsets of Data

Markov chain Monte Carlo (MCMC) is a popular and successful general-purp...
research
07/29/2021

Efficiently resolving rotational ambiguity in Bayesian matrix sampling with matching

A wide class of Bayesian models involve unidentifiable random matrices t...
research
06/02/2019

Clustering Multivariate Data using Factor Analytic Bayesian Mixtures with an Unknown Number of Components

Recent work on overfitting Bayesian mixtures of distributions offers a p...
research
04/11/2018

Sparse Bayesian Factor Analysis when the Number of Factors is Unknown

Despite the popularity of sparse factor models, little attention has bee...
research
03/30/2021

Post-Processing of MCMC

Markov chain Monte Carlo (MCMC) is the engine of modern Bayesian statist...
research
01/15/2020

Automated extraction of mutual independence patterns using Bayesian comparison of partition models

Mutual independence is a key concept in statistics that characterizes th...
research
02/01/2019

On the use of ABC-MCMC with inflated tolerance and post-correction

Approximate Bayesian computation (ABC) allows for inference of complicat...

Please sign up or login with your details

Forgot password? Click here to reset