Heterogeneous Deep Graph Infomax

11/19/2019
by   Yuxiang Ren, et al.
0

Graph representation learning is to learn universal node representations that preserve both node attributes and structural information. The derived node representations can be used to serve various downstream tasks, such as node classification and node clustering. When a graph is heterogeneous, the problem becomes more challenging than the homogeneous graph node learning problem. Inspired by the emerging information theoretic-based learning algorithm, in this paper we propose an unsupervised graph neural network Heterogeneous Deep Graph Infomax (HDGI) for heterogeneous graph representation learning. We use the meta-path structure to analyze the connections involving semantics in heterogeneous graphs and utilize graph convolution module and semantic-level attention mechanism to capture local representations. By maximizing local-global mutual information, HDGI effectively learns high-level node representations that can be utilized in downstream graph-related tasks. Experiment results show that HDGI remarkably outperforms state-of-the-art unsupervised graph representation learning methods on both classification and clustering tasks. By feeding the learned representations into a parametric model, such as logistic regression, we even achieve comparable performance in node classification tasks when comparing with state-of-the-art supervised end-to-end GNN models.

READ FULL TEXT
research
03/18/2020

Unsupervised Hierarchical Graph Representation Learning by Mutual Information Maximization

Graph representation learning based on graph neural networks (GNNs) can ...
research
02/05/2023

Deep Graph-Level Clustering Using Pseudo-Label-Guided Mutual Information Maximization Network

In this work, we study the problem of partitioning a set of graphs into ...
research
05/31/2022

Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation Learning

Unsupervised/self-supervised graph representation learning is critical f...
research
05/03/2018

SURREAL: SUbgraph Robust REpresentAtion Learning

The success of graph embeddings or node representation learning in a var...
research
11/29/2022

Text Representation Enrichment Utilizing Graph based Approaches: Stock Market Technical Analysis Case Study

Graph neural networks (GNNs) have been utilized for various natural lang...
research
11/15/2019

Unsupervised Attributed Multiplex Network Embedding

Nodes in a multiplex network are connected by multiple types of relation...
research
04/20/2021

Permutation-Invariant Variational Autoencoder for Graph-Level Representation Learning

Recently, there has been great success in applying deep neural networks ...

Please sign up or login with your details

Forgot password? Click here to reset