Graph Polynomial Convolution Models for Node Classification of Non-Homophilous Graphs

09/12/2022
by   Kishan Wimalawarne, et al.
0

We investigate efficient learning from higher-order graph convolution and learning directly from adjacency matrices for node classification. We revisit the scaled graph residual network and remove ReLU activation from residual layers and apply a single weight matrix at each residual layer. We show that the resulting model lead to new graph convolution models as a polynomial of the normalized adjacency matrix, the residual weight matrix, and the residual scaling parameter. Additionally, we propose adaptive learning between directly graph polynomial convolution models and learning directly from the adjacency matrix. Furthermore, we propose fully adaptive models to learn scaling parameters at each residual layer. We show that generalization bounds of proposed methods are bounded as a polynomial of eigenvalue spectrum, scaling parameters, and upper bounds of residual weights. By theoretical analysis, we argue that the proposed models can obtain improved generalization bounds by limiting the higher-orders of convolutions and direct learning from the adjacency matrix. Using a wide set of real-data, we demonstrate that the proposed methods obtain improved accuracy for node-classification of non-homophilous graphs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/24/2021

Adaptive and Interpretable Graph Convolution Networks Using Generalized Pagerank

We investigate adaptive layer-wise graph convolution in deep GCN models....
research
07/25/2020

Support of Closed Walks and Second Eigenvalue Multiplicity of the Normalized Adjacency Matrix

We show that the multiplicity of the second normalized adjacency matrix ...
research
03/15/2022

Graph Neural Network Sensitivity Under Probabilistic Error Model

Graph convolutional networks (GCNs) can successfully learn the graph sig...
research
04/11/2019

On the Displacement of Eigenvalues when Removing a Twin Vertex

Twin vertices of a graph have the same common neighbours. If they are ad...
research
12/30/2021

TextRGNN: Residual Graph Neural Networks for Text Classification

Recently, text classification model based on graph neural network (GNN) ...
research
11/23/2020

Scaling Wide Residual Networks for Panoptic Segmentation

The Wide Residual Networks (Wide-ResNets), a shallow but wide model vari...
research
05/03/2023

Rethinking Graph Lottery Tickets: Graph Sparsity Matters

Lottery Ticket Hypothesis (LTH) claims the existence of a winning ticket...

Please sign up or login with your details

Forgot password? Click here to reset