Pay Attention to Relations: Multi-embeddings for Attributed Multiplex Networks

by   Joshua Melton, et al.

Graph Convolutional Neural Networks (GCNs) have become effective machine learning algorithms for many downstream network mining tasks such as node classification, link prediction, and community detection. However, most GCN methods have been developed for homogenous networks and are limited to a single embedding for each node. Complex systems, often represented by heterogeneous, multiplex networks present a more difficult challenge for GCN models and require that such techniques capture the diverse contexts and assorted interactions that occur between nodes. In this work, we propose RAHMeN, a novel unified relation-aware embedding framework for attributed heterogeneous multiplex networks. Our model incorporates node attributes, motif-based features, relation-based GCN approaches, and relational self-attention to learn embeddings of nodes with respect to the various relations in a heterogeneous, multiplex network. In contrast to prior work, RAHMeN is a more expressive embedding framework that embraces the multi-faceted nature of nodes in such networks, producing a set of multi-embeddings that capture the varied and diverse contexts of nodes. We evaluate our model on four real-world datasets from Amazon, Twitter, YouTube, and Tissue PPIs in both transductive and inductive settings. Our results show that RAHMeN consistently outperforms comparable state-of-the-art network embedding models, and an analysis of RAHMeN's relational self-attention demonstrates that our model discovers interpretable connections between relations present in heterogeneous, multiplex networks.


page 1

page 7

page 8


Relation Structure-Aware Heterogeneous Information Network Embedding

Heterogeneous information network (HIN) embedding aims to embed multiple...

Multiplex Heterogeneous Graph Convolutional Network

Heterogeneous graph convolutional networks have gained great popularity ...

Representation Learning for Attributed Multiplex Heterogeneous Network

Network embedding (or graph embedding) has been widely used in many real...

A Self-Attention Network based Node Embedding Model

Despite several signs of progress have been made recently, limited resea...

Unsupervised Attributed Multiplex Network Embedding

Nodes in a multiplex network are connected by multiple types of relation...

Multi-Relation Aware Temporal Interaction Network Embedding

Temporal interaction networks are formed in many fields, e.g., e-commerc...

An OOD Multi-Task Perspective for Link Prediction with New Relation Types and Nodes

The task of inductive link prediction in (discrete) attributed multigrap...

Please sign up or login with your details

Forgot password? Click here to reset