DeepAI AI Chat
Log In Sign Up

Heterogeneous Representation Learning: A Review

by   Joey Tianyi Zhou, et al.
Nanyang Technological University
Agency for Science, Technology and Research

The real-world data usually exhibits heterogeneous properties such as modalities, views, or resources, which brings some unique challenges wherein the key is Heterogeneous Representation Learning (HRL) termed in this paper. This brief survey covers the topic of HRL, centered around several major learning settings and real-world applications. First of all, from the mathematical perspective, we present a unified learning framework which is able to model most existing learning settings with the heterogeneous inputs. After that, we conduct a comprehensive discussion on the HRL framework by reviewing some selected learning problems along with the mathematics perspectives, including multi-view learning, heterogeneous transfer learning, Learning using privileged information and heterogeneous multi-task learning. For each learning task, we also discuss some applications under these learning problems and instantiates the terms in the mathematical framework. Finally, we highlight the challenges that are less-touched in HRL and present future research directions. To the best of our knowledge, there is no such framework to unify these heterogeneous problems, and this survey would benefit the community.


page 1

page 2

page 3

page 4


A Survey on Heterogeneous Graph Embedding: Methods, Techniques, Applications and Sources

Heterogeneous graphs (HGs) also known as heterogeneous information netwo...

Robust Knowledge Discovery via Low-rank Modeling

It is always an attractive task to discover knowledge for various learni...

Biological Systems as Heterogeneous Information Networks: A Mini-review and Perspectives

In the real world, most objects and data have multiple types of attribut...

A Multi-Semantic Metapath Model for Large Scale Heterogeneous Network Representation Learning

Network Embedding has been widely studied to model and manage data in a ...

Learning with Constraint Learning: New Perspective, Solution Strategy and Various Applications

The complexity of learning problems, such as Generative Adversarial Netw...

Learning Multi-modal Similarity

In many applications involving multi-media data, the definition of simil...

Heterogeneous Network Representation Learning: Survey, Benchmark, Evaluation, and Beyond

Since real-world objects and their interactions are often multi-modal an...