A Taxonomy for Classification and Comparison of Dataflows for GNN Accelerators

03/14/2021
by   Raveesh Garg, et al.
0

Recently, Graph Neural Networks (GNNs) have received a lot of interest because of their success in learning representations from graph structured data. However, GNNs exhibit different compute and memory characteristics compared to traditional Deep Neural Networks (DNNs). Graph convolutions require feature aggregations from neighboring nodes (known as the aggregation phase), which leads to highly irregular data accesses. GNNs also have a very regular compute phase that can be broken down to matrix multiplications (known as the combination phase). All recently proposed GNN accelerators utilize different dataflows and microarchitecture optimizations for these two phases. Different communication strategies between the two phases have been also used. However, as more custom GNN accelerators are proposed, the harder it is to qualitatively classify them and quantitatively contrast them. In this work, we present a taxonomy to describe several diverse dataflows for running GNN inference on accelerators. This provides a structured way to describe and compare the design-space of GNN accelerators.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

page 11

research
09/30/2020

Computing Graph Neural Networks: A Survey from Algorithms to Accelerators

Graph Neural Networks (GNNs) have exploded onto the machine learning sce...
research
05/19/2022

Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysis

Graph neural networks (GNNs) are among the most powerful tools in deep l...
research
03/18/2021

Characterizing the Communication Requirements of GNN Accelerators: A Model-Based Approach

Relational data present in real world graph representations demands for ...
research
04/26/2023

SCV-GNN: Sparse Compressed Vector-based Graph Neural Network Aggregation

Graph neural networks (GNNs) have emerged as a powerful tool to process ...
research
11/14/2018

Pitfalls of Graph Neural Network Evaluation

Semi-supervised node classification in graphs is a fundamental problem i...
research
12/07/2022

Assessing and Analyzing the Resilience of Graph Neural Networks Against Hardware Faults

Graph neural networks (GNNs) have recently emerged as a promising learni...
research
05/29/2023

On the Correspondence Between Monotonic Max-Sum GNNs and Datalog

Although there has been significant interest in applying machine learnin...

Please sign up or login with your details

Forgot password? Click here to reset