Binarized Graph Neural Network

04/19/2020
by   Hanchen Wang, et al.
14

Recently, there have been some breakthroughs in graph analysis by applying the graph neural networks (GNNs) following a neighborhood aggregation scheme, which demonstrate outstanding performance in many tasks. However, we observe that the parameters of the network and the embedding of nodes are represented in real-valued matrices in existing GNN-based graph embedding approaches which may limit the efficiency and scalability of these models. It is well-known that binary vector is usually much more space and time efficient than the real-valued vector. This motivates us to develop a binarized graph neural network to learn the binary representations of the nodes with binary network parameters following the GNN-based paradigm. Our proposed method can be seamlessly integrated into the existing GNN-based embedding approaches to binarize the model parameters and learn the compact embedding. Extensive experiments indicate that the proposed binarized graph neural network, namely BGN, is orders of magnitude more efficient in terms of both time and space while matching the state-of-the-art performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2022

On Recoverability of Graph Neural Network Representations

Despite their growing popularity, graph neural networks (GNNs) still hav...
research
01/03/2022

Two-level Graph Neural Network

Graph Neural Networks (GNNs) are recently proposed neural network struct...
research
07/16/2022

Rewiring Networks for Graph Neural Network Training Using Discrete Geometry

Information over-squashing is a phenomenon of inefficient information pr...
research
06/16/2020

Isometric Graph Neural Networks

Many tasks that rely on representations of nodes in graphs would benefit...
research
02/23/2019

AliGraph: A Comprehensive Graph Neural Network Platform

An increasing number of machine learning tasks require dealing with larg...
research
04/20/2021

DeepHunter: A Graph Neural Network Based Approach for Robust Cyber Threat Hunting

Cyber Threat hunting is a proactive search for known attack behaviors in...
research
06/21/2023

DGC-GNN: Descriptor-free Geometric-Color Graph Neural Network for 2D-3D Matching

Direct matching of 2D keypoints in an input image to a 3D point cloud of...

Please sign up or login with your details

Forgot password? Click here to reset