DeepAI AI Chat
Log In Sign Up

Maximizing Mutual Information Across Feature and Topology Views for Learning Graph Representations

by   Xiaolong Fan, et al.

Recently, maximizing mutual information has emerged as a powerful method for unsupervised graph representation learning. The existing methods are typically effective to capture information from the topology view but ignore the feature view. To circumvent this issue, we propose a novel approach by exploiting mutual information maximization across feature and topology views. Specifically, we first utilize a multi-view representation learning module to better capture both local and global information content across feature and topology views on graphs. To model the information shared by the feature and topology spaces, we then develop a common representation learning module using mutual information maximization and reconstruction loss minimization. To explicitly encourage diversity between graph representations from the same view, we also introduce a disagreement regularization to enlarge the distance between representations from the same view. Experiments on synthetic and real-world datasets demonstrate the effectiveness of integrating feature and topology views. In particular, compared with the previous supervised methods, our proposed method can achieve comparable or even better performance under the unsupervised representation and linear evaluation protocol.


page 2

page 3

page 4

page 5

page 6

page 7

page 8

page 10


Multimodal Representation Learning via Maximization of Local Mutual Information

We propose and demonstrate a representation learning approach by maximiz...

On Mutual Information Maximization for Representation Learning

Many recent methods for unsupervised or self-supervised representation l...

Graph Representation Learning via Contrasting Cluster Assignments

With the rise of contrastive learning, unsupervised graph representation...

Learning Representations by Maximizing Mutual Information Across Views

We propose an approach to self-supervised representation learning based ...

Structure-Preserving Graph Representation Learning

Though graph representation learning (GRL) has made significant progress...

Multi-View MOOC Quality Evaluation via Information-Aware Graph Representation Learning

In this paper, we study the problem of MOOC quality evaluation which is ...

DiME: Maximizing Mutual Information by a Difference of Matrix-Based Entropies

We introduce an information-theoretic quantity with similar properties t...