DeepAI AI Chat
Log In Sign Up

Spike and slab Bayesian sparse principal component analysis

by   Bo Ning, et al.

Sparse principal component analysis (PCA) is a popular tool for dimensional reduction of high-dimensional data. Despite its massive popularity, there is still a lack of theoretically justifiable Bayesian sparse PCA that is computationally scalable. A major challenge is choosing a suitable prior for the loadings matrix, as principal components are mutually orthogonal. We propose a spike and slab prior that meets this orthogonality constraint and show that the posterior enjoys both theoretical and computational advantages. Two computational algorithms, the PX-CAVI and the PX-EM algorithms, are developed. Both algorithms use parameter expansion to deal with the orthogonality constraint and to accelerate their convergence speeds. We found that the PX-CAVI algorithm has superior empirical performance than the PX-EM algorithm and two other penalty methods for sparse PCA. The PX-CAVI algorithm is then applied to study a lung cancer gene expression dataset. 𝖱 package π–΅π–‘π—Œπ—‰π–Ίπ—‹π—Œπ–Ύπ–―π–’π–  with an implementation of the algorithm is available on The Comprehensive R Archive Network.


page 1

page 2

page 3

page 4

βˆ™ 11/19/2019

Gradient-based Sparse Principal Component Analysis with Extensions to Online Learning

Sparse principal component analysis (PCA) is an important technique for ...
βˆ™ 11/04/2013

TOP-SPIN: TOPic discovery via Sparse Principal component INterference

We propose a novel topic discovery algorithm for unlabeled images based ...
βˆ™ 06/16/2013

Do semidefinite relaxations solve sparse PCA up to the information limit?

Estimating the leading principal components of data, assuming they are s...
βˆ™ 01/07/2022

AugmentedPCA: A Python Package of Supervised and Adversarial Linear Factor Models

Deep autoencoders are often extended with a supervised or adversarial lo...
βˆ™ 12/12/2015

Sparse Generalized Principal Component Analysis for Large-scale Applications beyond Gaussianity

Principal Component Analysis (PCA) is a dimension reduction technique. I...
βˆ™ 12/29/2022

Theoretical Guarantees for Sparse Principal Component Analysis based on the Elastic Net

Sparse principal component analysis (SPCA) is widely used for dimensiona...
βˆ™ 09/29/2022

Automatic sparse PCA for high-dimensional data

Sparse principal component analysis (SPCA) methods have proven to effici...