Evolving Computation Graphs

06/22/2023
by   Andreea Deac, et al.
0

Graph neural networks (GNNs) have demonstrated success in modeling relational data, especially for data that exhibits homophily: when a connection between nodes tends to imply that they belong to the same class. However, while this assumption is true in many relevant situations, there are important real-world scenarios that violate this assumption, and this has spurred research into improving GNNs for these cases. In this work, we propose Evolving Computation Graphs (ECGs), a novel method for enhancing GNNs on heterophilic datasets. Our approach builds on prior theoretical insights linking node degree, high homophily, and inter vs intra-class embedding similarity by rewiring the GNNs' computation graph towards adding edges that connect nodes that are likely to be in the same class. We utilise weaker classifiers to identify these edges, ultimately improving GNN performance on non-homophilic data as a result. We evaluate ECGs on a diverse set of recently-proposed heterophilous datasets and demonstrate improvements over the relevant baselines. ECG presents a simple, intuitive and elegant approach for improving GNN performance on heterophilic datasets without requiring prior domain knowledge.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/07/2023

Reducing Over-smoothing in Graph Neural Networks Using Relational Embeddings

Graph Neural Networks (GNNs) have achieved a lot of success with graph-s...
research
11/20/2022

Enhancing Intra-class Information Extraction for Heterophilous Graphs: One Neural Architecture Search Approach

In recent years, Graph Neural Networks (GNNs) have been popular in graph...
research
02/22/2023

A critical look at the evaluation of GNNs under heterophily: are we really making progress?

Node classification is a classical graph representation learning task on...
research
09/12/2023

Information Flow in Graph Neural Networks: A Clinical Triage Use Case

Graph Neural Networks (GNNs) have gained popularity in healthcare and ot...
research
06/01/2023

SpotTarget: Rethinking the Effect of Target Edges for Link Prediction in Graph Neural Networks

Graph Neural Networks (GNNs) have demonstrated promising outcomes across...
research
03/27/2023

Towards Open Temporal Graph Neural Networks

Graph neural networks (GNNs) for temporal graphs have recently attracted...
research
02/07/2022

Neural Models for Output-Space Invariance in Combinatorial Problems

Recently many neural models have been proposed to solve combinatorial pu...

Please sign up or login with your details

Forgot password? Click here to reset