DeepAI AI Chat
Log In Sign Up

Exploring Edge Disentanglement for Node Classification

02/23/2022
by   Tianxiang Zhao, et al.
Penn State University
0

Edges in real-world graphs are typically formed by a variety of factors and carry diverse relation semantics. For example, connections in a social network could indicate friendship, being colleagues, or living in the same neighborhood. However, these latent factors are usually concealed behind mere edge existence due to the data collection and graph formation processes. Despite rapid developments in graph learning over these years, most models take a holistic approach and treat all edges as equal. One major difficulty in disentangling edges is the lack of explicit supervisions. In this work, with close examination of edge patterns, we propose three heuristics and design three corresponding pretext tasks to guide the automatic edge disentanglement. Concretely, these self-supervision tasks are enforced on a designed edge disentanglement module to be trained jointly with the downstream node classification task to encourage automatic edge disentanglement. Channels of the disentanglement module are expected to capture distinguishable relations and neighborhood interactions, and outputs from them are aggregated as node representations. The proposed DisGNN is easy to be incorporated with various neural architectures, and we conduct experiments on 6 real-world datasets. Empirical results show that it can achieve significant performance gains.

READ FULL TEXT
10/09/2020

Meta Graph Attention on Heterogeneous Graph with Node-Edge Co-evolution

Graph neural networks have become an important tool for modeling structu...
06/09/2020

Interpretable Deep Graph Generation with Node-Edge Co-Disentanglement

Disentangled representation learning has recently attracted a significan...
11/26/2019

Independence Promoted Graph Disentangled Networks

We address the problem of disentangled representation learning with inde...
09/30/2022

Direct Embedding of Temporal Network Edges via Time-Decayed Line Graphs

Temporal networks model a variety of important phenomena involving timed...
02/21/2023

Edgeformers: Graph-Empowered Transformers for Representation Learning on Textual-Edge Networks

Edges in many real-world social/information networks are associated with...
10/14/2021

Relation-aware Heterogeneous Graph for User Profiling

User profiling has long been an important problem that investigates user...