Probabilistic Contrastive Principal Component Analysis

12/14/2020
by   Didong Li, et al.
0

Dimension reduction is useful for exploratory data analysis. In many applications, it is of interest to discover variation that is enriched in a "foreground" dataset relative to a "background" dataset. Recently, contrastive principal component analysis (CPCA) was proposed for this setting. However, the lack of a formal probabilistic model makes it difficult to reason about CPCA and to tune its hyperparameter. In this work, we propose probabilistic contrastive principal component analysis (PCPCA), a model-based alternative to CPCA. We discuss how to set the hyperparameter in theory and in practice, and we show several of PCPCA's advantages, including greater interpretability, uncertainty quantification, robustness to noise and missing data, and the ability to generate data from the model. We demonstrate PCPCA's performance through a series of simulations and experiments with datasets of gene expression, protein expression, and images.

READ FULL TEXT
research
07/19/2023

A Dual Formulation for Probabilistic Principal Component Analysis

In this paper, we characterize Probabilistic Principal Component Analysi...
research
04/16/2021

Capturing patterns of variation unique to a specific dataset

Capturing patterns of variation present in a dataset is important in exp...
research
11/14/2022

An online algorithm for contrastive Principal Component Analysis

Finding informative low-dimensional representations that can be computed...
research
09/20/2017

Contrastive Principal Component Analysis

We present a new technique called contrastive principal component analys...
research
10/07/2019

Push it to the Limit: Discover Edge-Cases in Image Data with Autoencoders

In this paper, we focus on the problem of identifying semantic factors o...
research
01/29/2022

Deep Contrastive Learning is Provably (almost) Principal Component Analysis

We show that Contrastive Learning (CL) under a family of loss functions ...
research
06/19/2019

Identifying Missing Component in the Bechdel Test Using Principal Component Analysis Method

A lot has been said and discussed regarding the rationale and significan...

Please sign up or login with your details

Forgot password? Click here to reset