Path Integral Based Convolution and Pooling for Graph Neural Networks

06/29/2020
by   Zheng Ma, et al.
10

Graph neural networks (GNNs) extends the functionality of traditional neural networks to graph-structured data. Similar to CNNs, an optimized design of graph convolution and pooling is key to success. Borrowing ideas from physics, we propose a path integral based graph neural networks (PAN) for classification and regression tasks on graphs. Specifically, we consider a convolution operation that involves every path linking the message sender and receiver with learnable weights depending on the path length, which corresponds to the maximal entropy random walk. It generalizes the graph Laplacian to a new transition matrix we call maximal entropy transition (MET) matrix derived from a path integral formalism. Importantly, the diagonal entries of the MET matrix are directly related to the subgraph centrality, thus providing a natural and adaptive pooling mechanism. PAN provides a versatile framework that can be tailored for different graph data with varying sizes and structures. We can view most existing GNN architectures as special cases of PAN. Experimental results show that PAN achieves state-of-the-art performance on various graph classification/regression tasks, including a new benchmark dataset from statistical mechanics we propose to boost applications of GNN in physical sciences.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/26/2023

Path Integral Based Convolution and Pooling for Heterogeneous Graph Neural Networks

Graph neural networks (GNN) extends deep learning to graph-structure dat...
research
04/24/2019

PAN: Path Integral Based Convolution for Deep Graph Neural Networks

Convolution operations designed for graph-structured data usually utiliz...
research
07/22/2020

Graph Neural Networks with Haar Transform-Based Convolution and Pooling: A Complete Guide

Graph Neural Networks (GNNs) have recently caught great attention and ac...
research
09/25/2019

HaarPooling: Graph Pooling with Compressive Haar Basis

Deep Graph Neural Networks (GNNs) are instrumental in graph classificati...
research
03/06/2019

Relational Pooling for Graph Representations

This work generalizes graph neural networks (GNNs) beyond those based on...
research
12/26/2022

Statistical Mechanics of Generalization In Graph Convolution Networks

Graph neural networks (GNN) have become the default machine learning mod...

Please sign up or login with your details

Forgot password? Click here to reset