A Latent Variable Model for Two-Dimensional Canonical Correlation Analysis and its Variational Inference

08/04/2017
by   Mehran Safayani, et al.
0

Describing the dimension reduction (DR) techniques by means of probabilistic models has recently been given special attention. Probabilistic models, in addition to a better interpretability of the DR methods, provide a framework for further extensions of such algorithms. One of the new approaches to the probabilistic DR methods is to preserving the internal structure of data. It is meant that it is not necessary that the data first be converted from the matrix or tensor format to the vector format in the process of dimensionality reduction. In this paper, a latent variable model for matrix-variate data for canonical correlation analysis (CCA) is proposed. Since in general there is not any analytical maximum likelihood solution for this model, we present two approaches for learning the parameters. The proposed methods are evaluated using the synthetic data in terms of convergence and quality of mappings. Also, real data set is employed for assessing the proposed methods with several probabilistic and none-probabilistic CCA based approaches. The results confirm the superiority of the proposed methods with respect to the competing algorithms. Moreover, this model can be considered as a framework for further extensions.

READ FULL TEXT
research
04/15/2023

Dimensionality Reduction as Probabilistic Inference

Dimensionality reduction (DR) algorithms compress high-dimensional data ...
research
02/10/2018

Probabilistic Canonical Correlation Analysis: A Whitening Approach

Canonical correlation analysis (CCA) is a classic and widely used statis...
research
07/27/2019

Variational f-divergence Minimization

Probabilistic models are often trained by maximum likelihood, which corr...
research
01/31/2022

A Probabilistic Graph Coupling View of Dimension Reduction

Most popular dimension reduction (DR) methods like t-SNE and UMAP are ba...
research
06/19/2020

Latent variable modeling with random features

Gaussian process-based latent variable models are flexible and theoretic...
research
11/27/2014

Metrics for Probabilistic Geometries

We investigate the geometrical structure of probabilistic generative dim...
research
05/23/2023

SNEkhorn: Dimension Reduction with Symmetric Entropic Affinities

Many approaches in machine learning rely on a weighted graph to encode t...

Please sign up or login with your details

Forgot password? Click here to reset