Deep Partial Multi-View Learning

11/12/2020
by   Changqing Zhang, et al.
18

Although multi-view learning has made signifificant progress over the past few decades, it is still challenging due to the diffificulty in modeling complex correlations among different views, especially under the context of view missing. To address the challenge, we propose a novel framework termed Cross Partial Multi-View Networks (CPM-Nets), which aims to fully and flflexibly take advantage of multiple partial views. We fifirst provide a formal defifinition of completeness and versatility for multi-view representation and then theoretically prove the versatility of the learned latent representations. For completeness, the task of learning latent multi-view representation is specififically translated to a degradation process by mimicking data transmission, such that the optimal tradeoff between consistency and complementarity across different views can be implicitly achieved. Equipped with adversarial strategy, our model stably imputes missing views, encoding information from all views for each sample to be encoded into latent representation to further enhance the completeness. Furthermore, a nonparametric classifification loss is introduced to produce structured representations and prevent overfifitting, which endows the algorithm with promising generalization under view-missing cases. Extensive experimental results validate the effectiveness of our algorithm over existing state of the arts for classifification, representation learning and data imputation.

READ FULL TEXT

page 8

page 10

page 11

page 12

page 14

research
08/29/2022

Latent Heterogeneous Graph Network for Incomplete Multi-View Learning

Multi-view learning has progressed rapidly in recent years. Although man...
research
01/15/2022

Multi-View representation learning in Multi-Task Scene

Over recent decades have witnessed considerable progress in whether mult...
research
04/04/2019

Multi-View Intact Space Learning

It is practical to assume that an individual view is unlikely to be suff...
research
12/12/2019

Towards Disentangled Representations for Human Retargeting by Multi-view Learning

We study the problem of learning disentangled representations for data a...
research
11/04/2020

Muti-view Mouse Social Behaviour Recognition with Deep Graphical Model

Home-cage social behaviour analysis of mice is an invaluable tool to ass...
research
05/05/2021

MCGNet: Partial Multi-view Few-shot Learning via Meta-alignment and Context Gated-aggregation

In this paper, we propose a new challenging task named as partial multi-...
research
08/22/2017

VIGAN: Missing View Imputation with Generative Adversarial Networks

In an era when big data are becoming the norm, there is less concern wit...

Please sign up or login with your details

Forgot password? Click here to reset