Unsupervised learning with contrastive latent variable models

by   Kristen Severson, et al.

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in one dataset relative to another. These pairs of datasets occur commonly, for instance a population of interest vs. control or signal vs. signal free recordings.However, there are few methods that work on sets of data as opposed to data points or sequences. Here, we present a probabilistic model for dimensionality reduction to discover signal that is enriched in the target dataset relative to the background dataset. The data in these sets do not need to be paired or grouped beyond set membership. By using a probabilistic model where some structure is shared amongst the two datasets and some is unique to the target dataset, we are able to recover interesting structure in the latent space of the target dataset. The method also has the advantages of a probabilistic model, namely that it allows for the incorporation of prior information, handles missing data, and can be generalized to different distributional assumptions. We describe several possible variations of the model and demonstrate the application of the technique to de-noising, feature selection, and subgroup discovery settings.


Unsupervised Learning with Imbalanced Data via Structure Consolidation Latent Variable Model

Unsupervised learning on imbalanced data is challenging because, when gi...

Nonlinear Dimensionality Reduction for Discriminative Analytics of Multiple Datasets

Principal component analysis (PCA) is widely used for feature extraction...

Capturing patterns of variation unique to a specific dataset

Capturing patterns of variation present in a dataset is important in exp...

Moment Matching Deep Contrastive Latent Variable Models

In the contrastive analysis (CA) setting, machine learning practitioners...

Contrastive Multivariate Singular Spectrum Analysis

We introduce Contrastive Multivariate Singular Spectrum Analysis, a nove...

Representative period selection for power system planning using autoencoder-based dimensionality reduction

Power sector capacity expansion models (CEMs) that are used for studying...

Latent Feature Representation via Unsupervised Learning for Pattern Discovery in Massive Electron Microscopy Image Volumes

We propose a method to facilitate exploration and analysis of new large ...

Please sign up or login with your details

Forgot password? Click here to reset