Multipath Graph Convolutional Neural Networks

05/04/2021
by   Rangan Das, et al.
0

Graph convolution networks have recently garnered a lot of attention for representation learning on non-Euclidean feature spaces. Recent research has focused on stacking multiple layers like in convolutional neural networks for the increased expressive power of graph convolution networks. However, simply stacking multiple graph convolution layers lead to issues like vanishing gradient, over-fitting and over-smoothing. Such problems are much less when using shallower networks, even though the shallow networks have lower expressive power. In this work, we propose a novel Multipath Graph convolutional neural network that aggregates the output of multiple different shallow networks. We train and test our model on various benchmarks datasets for the task of node property prediction. Results show that the proposed method not only attains increased test accuracy but also requires fewer training epochs to converge. The full implementation is available at https://github.com/rangan2510/MultiPathGCN

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

03/11/2020

Convolutional Kernel Networks for Graph-Structured Data

We introduce a family of multilayer graph kernels and establish new link...
11/21/2015

GradNets: Dynamic Interpolation Between Neural Architectures

In machine learning, there is a fundamental trade-off between ease of op...
01/19/2018

EffNet: An Efficient Structure for Convolutional Neural Networks

With the ever increasing application of Convolutional Neural Networks to...
10/01/2018

Elastic Neural Networks for Classification

In this work we propose a framework for improving the performance of any...
06/26/2020

Relative gradient optimization of the Jacobian term in unsupervised deep learning

Learning expressive probabilistic models correctly describing the data i...
10/15/2019

DeepGCNs: Making GCNs Go as Deep as CNNs

Convolutional Neural Networks (CNNs) have been very successful at solvin...
05/30/2021

How Attentive are Graph Attention Networks?

Graph Attention Networks (GATs) are one of the most popular GNN architec...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.