Common Representation Learning Using Step-based Correlation Multi-Modal CNN

10/31/2017
by   Gaurav Bhatt, et al.
0

Deep learning techniques have been successfully used in learning a common representation for multi-view data, wherein the different modalities are projected onto a common subspace. In a broader perspective, the techniques used to investigate common representation learning falls under the categories of canonical correlation-based approaches and autoencoder based approaches. In this paper, we investigate the performance of deep autoencoder based methods on multi-view data. We propose a novel step-based correlation multi-modal CNN (CorrMCNN) which reconstructs one view of the data given the other while increasing the interaction between the representations at each hidden layer or every intermediate step. Finally, we evaluate the performance of the proposed model on two benchmark datasets - MNIST and XRMB. Through extensive experiments, we find that the proposed model achieves better performance than the current state-of-the-art techniques on joint common representation learning and transfer learning tasks.

READ FULL TEXT
research
10/03/2016

Multi-View Representation Learning: A Survey from Shallow Methods to Deep Methods

Recently, multi-view representation learning has become a rapidly growin...
research
04/27/2015

Correlational Neural Networks

Common Representation Learning (CRL), wherein different descriptions (or...
research
04/03/2019

Multimodal Representation Learning using Deep Multiset Canonical Correlation

We propose Deep Multiset Canonical Correlation Analysis (dMCCA) as an ex...
research
07/03/2019

Canonical Correlation Analysis (CCA) Based Multi-View Learning: An Overview

Multi-view learning (MVL) is a strategy for fusing data from different s...
research
07/30/2017

Deep Multi-View Learning with Stochastic Decorrelation Loss

Multi-view learning aims to learn an embedding space where multiple view...
research
04/14/2022

Early Myocardial Infarction Detection with One-Class Classification over Multi-view Echocardiography

Myocardial infarction (MI) is the leading cause of mortality and morbidi...
research
06/26/2019

Task-Driven Common Representation Learning via Bridge Neural Network

This paper introduces a novel deep learning based method, named bridge n...

Please sign up or login with your details

Forgot password? Click here to reset