On the Correspondence Between Monotonic Max-Sum GNNs and Datalog

05/29/2023
by   David Tena Cucala, et al.
0

Although there has been significant interest in applying machine learning techniques to structured data, the expressivity (i.e., a description of what can be learned) of such techniques is still poorly understood. In this paper, we study data transformations based on graph neural networks (GNNs). First, we note that the choice of how a dataset is encoded into a numeric form processable by a GNN can obscure the characterisation of a model's expressivity, and we argue that a canonical encoding provides an appropriate basis. Second, we study the expressivity of monotonic max-sum GNNs, which cover a subclass of GNNs with max and sum aggregation functions. We show that, for each such GNN, one can compute a Datalog program such that applying the GNN to any dataset produces the same facts as a single round of application of the program's rules to the dataset. Monotonic max-sum GNNs can sum an unbounded number of feature vectors which can result in arbitrarily large feature values, whereas rule application requires only a bounded number of constants. Hence, our result shows that the unbounded summation of monotonic max-sum GNNs does not increase their expressive power. Third, we sharpen our result to the subclass of monotonic max GNNs, which use only the max aggregation function, and identify a corresponding class of Datalog programs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2023

Some Might Say All You Need Is Sum

The expressivity of Graph Neural Networks (GNNs) is dependent on the agg...
research
09/19/2022

Revisiting Embeddings for Graph Neural Networks

Current graph representation learning techniques use Graph Neural Networ...
research
02/18/2022

Generalizing Aggregation Functions in GNNs:High-Capacity GNNs via Nonlinear Neighborhood Aggregators

Graph neural networks (GNNs) have achieved great success in many graph l...
research
12/15/2020

Learning Aggregation Functions

Learning on sets is increasingly gaining attention in the machine learni...
research
12/14/2020

Breaking the Expressive Bottlenecks of Graph Neural Networks

Recently, the Weisfeiler-Lehman (WL) graph isomorphism test was used to ...
research
03/14/2021

A Taxonomy for Classification and Comparison of Dataflows for GNN Accelerators

Recently, Graph Neural Networks (GNNs) have received a lot of interest b...
research
06/24/2023

Generalised f-Mean Aggregation for Graph Neural Networks

Graph Neural Network (GNN) architectures are defined by their implementa...

Please sign up or login with your details

Forgot password? Click here to reset