Towards Expressive Graph Representation

10/12/2020
by   Chengsheng Mao, et al.
0

Graph Neural Network (GNN) aggregates the neighborhood of each node into the node embedding and shows its powerful capability for graph representation learning. However, most existing GNN variants aggregate the neighborhood information in a fixed non-injective fashion, which may map different graphs or nodes to the same embedding, reducing the model expressiveness. We present a theoretical framework to design a continuous injective set function for neighborhood aggregation in GNN. Using the framework, we propose expressive GNN that aggregates the neighborhood of each node with a continuous injective set function, so that a GNN layer maps similar nodes with similar neighborhoods to similar embeddings, different nodes to different embeddings and the equivalent nodes or isomorphic graphs to the same embeddings. Moreover, the proposed expressive GNN can naturally learn expressive representations for graphs with continuous node attributes. We validate the proposed expressive GNN (ExpGNN) for graph classification on multiple benchmark datasets including simple graphs and attributed graphs. The experimental results demonstrate that our model achieves state-of-the-art performances on most of the benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2022

Distribution Preserving Graph Representation Learning

Graph neural network (GNN) is effective to model graphs for distributed ...
research
11/17/2021

IV-GNN : Interval Valued Data Handling Using Graph Neural Network

Graph Neural Network (GNN) is a powerful tool to perform standard machin...
research
04/12/2021

Edgeless-GNN: Unsupervised Inductive Edgeless Network Embedding

We study the problem of embedding edgeless nodes such as users who newly...
research
09/03/2020

CAGNN: Cluster-Aware Graph Neural Networks for Unsupervised Graph Representation Learning

Unsupervised graph representation learning aims to learn low-dimensional...
research
11/19/2018

Role action embeddings: scalable representation of network positions

We consider the question of embedding nodes with similar local neighborh...
research
06/16/2020

Isometric Graph Neural Networks

Many tasks that rely on representations of nodes in graphs would benefit...
research
09/20/2023

InkStream: Real-time GNN Inference on Streaming Graphs via Incremental Update

Classic Graph Neural Network (GNN) inference approaches, designed for st...

Please sign up or login with your details

Forgot password? Click here to reset