Data efficiency in graph networks through equivariance

06/25/2021
by   Francesco Farina, et al.
0

We introduce a novel architecture for graph networks which is equivariant to any transformation in the coordinate embeddings that preserves the distance between neighbouring nodes. In particular, it is equivariant to the Euclidean and conformal orthogonal groups in n-dimensions. Thanks to its equivariance properties, the proposed model is extremely more data efficient with respect to classical graph architectures and also intrinsically equipped with a better inductive bias. We show that, learning on a minimal amount of data, the architecture we propose can perfectly generalise to unseen data in a synthetic problem, while much more training data are required from a standard model to reach comparable performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2021

Beyond permutation equivariance in graph networks

We introduce a novel architecture for graph networks which is equivarian...
research
05/28/2021

Symmetry-driven graph neural networks

Exploiting symmetries and invariance in data is a powerful, yet not full...
research
02/14/2020

An Inductive Bias for Distances: Neural Nets that Respect the Triangle Inequality

Distances are pervasive in machine learning. They serve as similarity me...
research
07/29/2023

Graph Condensation for Inductive Node Representation Learning

Graph neural networks (GNNs) encounter significant computational challen...
research
12/20/2021

Lifelong Learning in Evolving Graphs with Limited Labeled Data and Unseen Class Detection

Large-scale graph data in the real-world are often dynamic rather than s...
research
04/09/2020

Orthogonal Over-Parameterized Training

The inductive bias of a neural network is largely determined by the arch...
research
04/08/2021

Scaling up graph homomorphism for classification via sampling

Feature generation is an open topic of investigation in graph machine le...

Please sign up or login with your details

Forgot password? Click here to reset