Graph Neural Networks with Precomputed Node Features

06/01/2022
by   Beni Egressy, et al.
0

Most Graph Neural Networks (GNNs) cannot distinguish some graphs or indeed some pairs of nodes within a graph. This makes it impossible to solve certain classification tasks. However, adding additional node features to these models can resolve this problem. We introduce several such augmentations, including (i) positional node embeddings, (ii) canonical node IDs, and (iii) random features. These extensions are motivated by theoretical results and corroborated by extensive testing on synthetic subgraph detection tasks. We find that positional embeddings significantly outperform other extensions in these tasks. Moreover, positional embeddings have better sample efficiency, perform well on different graph distributions and even outperform learning with ground truth node positions. Finally, we show that the different augmentations perform competitively on established GNN benchmarks, and advise on when to use them.

READ FULL TEXT

page 7

page 12

page 13

research
06/11/2019

Position-aware Graph Neural Networks

Learning node embeddings that capture a node's position within the broad...
research
06/22/2022

Agent-based Graph Neural Networks

We present a novel graph neural network we call AgentNet, which is desig...
research
10/01/2019

On the Equivalence between Node Embeddings and Structural Graph Representations

This work provides the first unifying theoretical framework for node emb...
research
04/07/2023

Distributional Signals for Node Classification in Graph Neural Networks

In graph neural networks (GNNs), both node features and labels are examp...
research
11/11/2022

Graph-Conditioned MLP for High-Dimensional Tabular Biomedical Data

Genome-wide studies leveraging recent high-throughput sequencing technol...
research
12/21/2022

A Non-Asymptotic Analysis of Oversmoothing in Graph Neural Networks

A central challenge of building more powerful Graph Neural Networks (GNN...
research
11/19/2018

Role action embeddings: scalable representation of network positions

We consider the question of embedding nodes with similar local neighborh...

Please sign up or login with your details

Forgot password? Click here to reset