A Flexible Framework for Large Graph Learning

03/21/2020
by   Dalong Yang, et al.
0

Graph Convolutional Network (GCN) has shown strong effectiveness in graph learning tasks. However, GCN faces challenges in flexibility due to the fact of requiring the full graph Laplacian available in the training phase. Moreover, with the depth of layers increases, the computational and memory cost of GCN grows explosively on account of the recursive neighborhood expansion, which leads to a limitation in processing large graphs. To tackle these issues, we take advantage of image processing in agility and present Node2Img, a flexible architecture for large-scale graph learning. Node2Img maps the nodes to "images" (i.e. grid-like data in Euclidean space) which can be the inputs of Convolutional Neural Network (CNN). Instead of leveraging the fixed whole network as a batch to train the model, Node2Img supports a more efficacious framework in practice, where the batch size can be set elastically and the data in the same batch can be calculated parallelly. Specifically, by ranking each node's influence through degree, Node2Img selects the most influential first-order as well as second-order neighbors with central node fusion information to construct the grid-like data. For further improving the efficiency of downstream tasks, a simple CNN-based neural network is employed to capture the significant information from the Euclidean grids. Additionally, the attention mechanism is implemented, which enables implicitly specifying the different weights for neighboring nodes with different influences. Extensive experiments on real graphs' transductive and inductive learning tasks demonstrate the superiority of the proposed Node2Img model against the state-of-the-art GCN-based approaches.

READ FULL TEXT
research
11/17/2020

MG-GCN: Fast and Effective Learning with Mix-grained Aggregators for Training Large Graph Convolutional Networks

Graph convolutional networks (GCNs) have been employed as a kind of sign...
research
05/31/2018

Fusion Graph Convolutional Networks

Semi-supervised node classification involves learning to classify unlabe...
research
05/12/2020

Benchmark Tests of Convolutional Neural Network and Graph Convolutional Network on HorovodRunner Enabled Spark Clusters

The freedom of fast iterations of distributed deep learning tasks is cru...
research
12/27/2021

Block Modeling-Guided Graph Convolutional Neural Networks

Graph Convolutional Network (GCN) has shown remarkable potential of expl...
research
07/30/2020

grid2vec: Learning Efficient Visual Representations via Flexible Grid-Graphs

We propose grid2vec, a novel approach for image representation learning ...
research
02/28/2022

RawlsGCN: Towards Rawlsian Difference Principle on Graph Convolutional Network

Graph Convolutional Network (GCN) plays pivotal roles in many real-world...
research
08/12/2018

Large-Scale Learnable Graph Convolutional Networks

Convolutional neural networks (CNNs) have achieved great success on grid...

Please sign up or login with your details

Forgot password? Click here to reset