Adaptive fractional order graph neural network

01/05/2020
by   Zijian Liu, et al.
45

This paper proposes adaptive fractional order graph neural network (AFGNN), optimized by a time-varying fractional order gradient descent method to address the challenges of local optimum of classic and fractional GNNs which are specialised at aggregating information from the feature and adjacent matrices of connected nodes and their neighbours to solve learning tasks on non-Euclidean data such as graphs. To overcome the high computational complexity of fractional order derivations, the proposed model approximately calculates the fractional order gradients. We further prove such approximation is feasible and the AFGNN is unbiased. Extensive experiments on benchmark citation networks and object recognition challenges confirm the performance of AFGNN. The first group of experiments show that the results of AFGNN outperform the steepest gradient based method and conventional GNNs on the citation networks. The second group of experiments demonstrate that AFGNN excels at image recognition tasks where the images have a significant amount of missing pixels and expresses improved accuracy than GNNs.

READ FULL TEXT
research
05/14/2019

Convolutional neural networks with fractional order gradient method

This paper proposes a fractional order gradient method for the backward ...
research
06/07/2021

Increase and Conquer: Training Graph Neural Networks on Growing Graphs

Graph neural networks (GNNs) use graph convolutions to exploit network i...
research
12/04/2021

Fast Graph Neural Tangent Kernel via Kronecker Sketching

Many deep learning tasks have to deal with graphs (e.g., protein structu...
research
05/22/2023

A Fractional Graph Laplacian Approach to Oversmoothing

Graph neural networks (GNNs) have shown state-of-the-art performances in...
research
06/01/2023

Renormalized Graph Neural Networks

Graph Neural Networks (GNNs) have become essential for studying complex ...

Please sign up or login with your details

Forgot password? Click here to reset