Cross-modal subspace learning with Kernel correlation maximization and Discriminative structure preserving

03/26/2019
by   Jun Yu, et al.
0

The measure between heterogeneous data is still an open problem. Many research works have been developed to learn a common subspace where the similarity between different modalities can be calculated. However, most of existing works focus on learning low dimensional subspace and ignore the loss of discriminative information in process of reducing dimension. Thus, these approaches cannot get the results they expected. On basis of the Hilbert space theory in which different Hilbert spaces but with same dimension are isomorphic, we propose a novel framework where the multiple use of label information can facilitate more discriminative subspace representation to learn isomorphic Hilbert space for each modal. Our model not only considers the inter-modality correlation by maximizing the kernel correlation, but also preserves the structure information within each modal according to constructed graph model. Extensive experiments are performed to evaluate the proposed framework, termed Cross-modal subspace learning with Kernel correlation maximization and Discriminative structure preserving (CKD), on the three public datasets. Experimental results demonstrated the competitive performance of the proposed CKD compared with the classic subspace learning methods.

READ FULL TEXT
research
01/26/2022

Discriminative Supervised Subspace Learning for Cross-modal Retrieval

Nowadays the measure between heterogeneous data is still an open problem...
research
10/14/2017

CM-GANs: Cross-modal Generative Adversarial Networks for Common Representation Learning

It is known that the inconsistent distribution and representation of dif...
research
12/06/2018

Discriminative Supervised Hashing for Cross-Modal similarity Search

With the advantage of low storage cost and high retrieval efficiency, ha...
research
04/16/2019

Shared Predictive Cross-Modal Deep Quantization

With explosive growth of data volume and ever-increasing diversity of da...
research
11/07/2022

Complete Cross-triplet Loss in Label Space for Audio-visual Cross-modal Retrieval

The heterogeneity gap problem is the main challenge in cross-modal retri...
research
03/26/2019

Unsupervised Concatenation Hashing with Sparse Constraint for Cross-Modal Retrieval

With the advantage of low storage cost and high efficiency, hashing lear...
research
03/11/2019

Similarity Learning via Kernel Preserving Embedding

Data similarity is a key concept in many data-driven applications. Many ...

Please sign up or login with your details

Forgot password? Click here to reset