Multi-view Feature Extraction based on Triple Contrastive Heads

03/22/2023
by   Hongjie Zhang, et al.
0

Multi-view feature extraction is an efficient approach for alleviating the issue of dimensionality in highdimensional multi-view data. Contrastive learning (CL), which is a popular self-supervised learning method, has recently attracted considerable attention. In this study, we propose a novel multi-view feature extraction method based on triple contrastive heads, which combines the sample-, recovery- , and feature-level contrastive losses to extract the sufficient yet minimal subspace discriminative information in compliance with information bottleneck principle. In MFETCH, we construct the feature-level contrastive loss, which removes the redundent information in the consistency information to achieve the minimality of the subspace discriminative information. Moreover, the recovery-level contrastive loss is also constructed in MFETCH, which captures the view-specific discriminative information to achieve the sufficiency of the subspace discriminative information.The numerical experiments demonstrate that the proposed method offers a strong advantage for multi-view feature extraction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2023

Multi-view Feature Extraction based on Dual Contrastive Head

Multi-view feature extraction is an efficient approach for alleviating t...
research
01/11/2022

Feature Extraction Framework based on Contrastive Learning with Adaptive Positive and Negative Samples

In this study, we propose a feature extraction framework based on contra...
research
03/27/2022

Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object Tracking

Discriminative representation is crucial for the association step in mul...
research
06/26/2023

Contrastive Multi-view Framework for Customer Lifetime Value Prediction

Accurate customer lifetime value (LTV) prediction can help service provi...
research
07/01/2022

Personalized Diagnostic Tool for Thyroid Cancer Classification using Multi-view Ultrasound

Over the past decades, the incidence of thyroid cancer has been increasi...
research
03/15/2022

Multi-View Dreaming: Multi-View World Model with Contrastive Learning

In this paper, we propose Multi-View Dreaming, a novel reinforcement lea...
research
05/18/2021

Multi-view Contrastive Coding of Remote Sensing Images at Pixel-level

Our planet is viewed by satellites through multiple sensors (e.g., multi...

Please sign up or login with your details

Forgot password? Click here to reset