Framelet Message Passing

02/28/2023
by   Xinliang Liu, et al.
0

Graph neural networks (GNNs) have achieved champion in wide applications. Neural message passing is a typical key module for feature propagation by aggregating neighboring features. In this work, we propose a new message passing based on multiscale framelet transforms, called Framelet Message Passing. Different from traditional spatial methods, it integrates framelet representation of neighbor nodes from multiple hops away in node message update. We also propose a continuous message passing using neural ODE solvers. It turns both discrete and continuous cases can provably achieve network stability and limit oversmoothing due to the multiscale property of framelets. Numerical experiments on real graph datasets show that the continuous version of the framelet message passing significantly outperforms existing methods when learning heterogeneous graphs and achieves state-of-the-art performance on classic node classification tasks with low computational costs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2022

Memory-based Message Passing: Decoupling the Message for Propogation from Discrimination

Message passing is a fundamental procedure for graph neural networks in ...
research
08/17/2019

Message Passing Attention Networks for Document Understanding

Most graph neural networks can be described in terms of message passing,...
research
01/04/2022

Graph Decipher: A transparent dual-attention graph neural network to understand the message-passing mechanism for the node classification

Graph neural networks can be effectively applied to find solutions for m...
research
04/27/2022

GTNet: A Tree-Based Deep Graph Learning Architecture

We propose Graph Tree Networks (GTNets), a deep graph learning architect...
research
10/24/2020

Pathfinder Discovery Networks for Neural Message Passing

In this work we propose Pathfinder Discovery Networks (PDNs), a method f...
research
03/04/2020

PushNet: Efficient and Adaptive Neural Message Passing

Message passing neural networks have recently evolved into a state-of-th...
research
12/05/2022

TIDE: Time Derivative Diffusion for Deep Learning on Graphs

A prominent paradigm for graph neural networks is based on the message p...

Please sign up or login with your details

Forgot password? Click here to reset