ReGraphX: NoC-enabled 3D Heterogeneous ReRAM Architecture for Training Graph Neural Networks

02/16/2021
by   Aqeeb Iqbal Arka, et al.
0

Graph Neural Network (GNN) is a variant of Deep Neural Networks (DNNs) operating on graphs. However, GNNs are more complex compared to traditional DNNs as they simultaneously exhibit features of both DNN and graph applications. As a result, architectures specifically optimized for either DNNs or graph applications are not suited for GNN training. In this work, we propose a 3D heterogeneous manycore architecture for on-chip GNN training to address this problem. The proposed architecture, ReGraphX, involves heterogeneous ReRAM crossbars to fulfill the disparate requirements of both DNN and graph computations simultaneously. The ReRAM-based architecture is complemented with a multicast-enabled 3D NoC to improve the overall achievable performance. We demonstrate that ReGraphX outperforms conventional GPUs by up to 3.5X (on an average 3X) in terms of execution time, while reducing energy consumption by as much as 11X.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/19/2020

Improving the Long-Range Performance of Gated Graph Neural Networks

Many popular variants of graph neural networks (GNNs) that are capable o...
research
11/06/2020

Learning Power Control for Cellular Systems with Heterogeneous Graph Neural Network

Optimizing power control in multi-cell cellular networks with deep learn...
research
09/11/2020

Graph Neural Network based Service Function Chaining for Automatic Network Control

Software-defined networking (SDN) and the network function virtualizatio...
research
07/16/2023

MaGNAS: A Mapping-Aware Graph Neural Architecture Search Framework for Heterogeneous MPSoC Deployment

Graph Neural Networks (GNNs) are becoming increasingly popular for visio...
research
09/07/2022

Spotting Virus from Satellites: Modeling the Circulation of West Nile Virus Through Graph Neural Networks

The occurrence of West Nile Virus (WNV) represents one of the most commo...
research
11/20/2019

Fast and Deep Graph Neural Networks

We address the efficiency issue for the construction of a deep graph neu...
research
10/23/2020

Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks

Graph neural networks (GNNs) have emerged as a powerful tool for learnin...

Please sign up or login with your details

Forgot password? Click here to reset