Self-supervised Auxiliary Learning with Meta-paths for Heterogeneous Graphs

07/16/2020
by   Dasol Hwang, et al.
26

Graph neural networks have shown superior performance in a wide range of applications providing a powerful representation of graph-structured data. Recent works show that the representation can be further improved by auxiliary tasks. However, the auxiliary tasks for heterogeneous graphs, which contain rich semantic information with various types of nodes and edges, have less explored in the literature. In this paper, to learn graph neural networks on heterogeneous graphs we propose a novel self-supervised auxiliary learning method using meta-paths, which are composite relations of multiple edge types. Our proposed method is learning to learn a primary task by predicting meta-paths as auxiliary tasks. This can be viewed as a type of meta-learning. The proposed method can identify an effective combination of auxiliary tasks and automatically balance them to improve the primary task. Our methods can be applied to any graph neural networks in a plug-in manner without manual labeling or additional data. The experiments demonstrate that the proposed method consistently improves the performance of link prediction and node classification on heterogeneous graphs.

READ FULL TEXT
research
03/01/2021

Self-supervised Auxiliary Learning for Graph Neural Networks via Meta-Learning

In recent years, graph neural networks (GNNs) have been widely adopted i...
research
09/09/2022

Self-supervised Learning for Heterogeneous Graph via Structure Information based on Metapath

graph neural networks (GNNs) are the dominant paradigm for modeling and ...
research
01/25/2019

Self-Supervised Generalisation with Meta Auxiliary Learning

Learning with auxiliary tasks has been shown to improve the generalisati...
research
09/07/2018

Feature Learning for Meta-Paths in Knowledge Graphs

In this thesis, we study the problem of feature learning on heterogeneou...
research
11/27/2022

Differentiable Meta Multigraph Search with Partial Message Propagation on Heterogeneous Information Networks

Heterogeneous information networks (HINs) are widely employed for descri...
research
03/29/2021

Learning on heterogeneous graphs using high-order relations

A heterogeneous graph consists of different vertices and edges types. Le...
research
06/23/2020

Gaining insight into SARS-CoV-2 infection and COVID-19 severity using self-supervised edge features and Graph Neural Networks

Graph Neural Networks (GNN) have been extensively used to extract meanin...

Please sign up or login with your details

Forgot password? Click here to reset