Learning Parametrised Graph Shift Operators

01/25/2021
by   George Dasoulas, et al.
0

In many domains data is currently represented as graphs and therefore, the graph representation of this data becomes increasingly important in machine learning. Network data is, implicitly or explicitly, always represented using a graph shift operator (GSO) with the most common choices being the adjacency, Laplacian matrices and their normalisations. In this paper, a novel parametrised GSO (PGSO) is proposed, where specific parameter values result in the most commonly used GSOs and message-passing operators in graph neural network (GNN) frameworks. The PGSO is suggested as a replacement of the standard GSOs that are used in state-of-the-art GNN architectures and the optimisation of the PGSO parameters is seamlessly included in the model training. It is proved that the PGSO has real eigenvalues and a set of real eigenvectors independent of the parameter values and spectral bounds on the PGSO are derived. PGSO parameters are shown to adapt to the sparsity of the graph structure in a study on stochastic blockmodel networks, where they are found to automatically replicate the GSO regularisation found in the literature. On several real-world datasets the accuracy of state-of-the-art GNN architectures is improved by the inclusion of the PGSO in both node- and graph-classification tasks.

READ FULL TEXT

page 9

page 13

research
10/03/2022

ASGNN: Graph Neural Networks with Adaptive Structure

The graph neural network (GNN) models have presented impressive achievem...
research
06/08/2021

Graph-MLP: Node Classification without Message Passing in Graph

Graph Neural Network (GNN) has been demonstrated its effectiveness in de...
research
11/17/2021

IV-GNN : Interval Valued Data Handling Using Graph Neural Network

Graph Neural Network (GNN) is a powerful tool to perform standard machin...
research
02/09/2021

SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networks

Graph neural networks (GNNs) work well when the graph structure is provi...
research
08/05/2019

A Unifying Analysis of Shift Operators on a Graph

The maximum entropy principle is employed to introduce a general class o...
research
09/06/2021

Pointspectrum: Equivariance Meets Laplacian Filtering for Graph Representation Learning

Graph Representation Learning (GRL) has become essential for modern grap...
research
08/19/2020

Training Sensitivity in Graph Isomorphism Network

Graph neural network (GNN) is a popular tool to learn the lower-dimensio...

Please sign up or login with your details

Forgot password? Click here to reset