Learning Graph Neural Networks using Exact Compression

04/28/2023
by   Jeroen Bollen, et al.
0

Graph Neural Networks (GNNs) are a form of deep learning that enable a wide range of machine learning applications on graph-structured data. The learning of GNNs, however, is known to pose challenges for memory-constrained devices such as GPUs. In this paper, we study exact compression as a way to reduce the memory requirements of learning GNNs on large graphs. In particular, we adopt a formal approach to compression and propose a methodology that transforms GNN learning problems into provably equivalent compressed GNN learning problems. In a preliminary experimental evaluation, we give insights into the compression ratios that can be obtained on real-world graphs and apply our methodology to an existing GNN benchmark.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2021

The Logic of Graph Neural Networks

Graph neural networks (GNNs) are deep learning architectures for machine...
research
08/06/2022

Triple Sparsification of Graph Convolutional Networks without Sacrificing the Accuracy

Graph Neural Networks (GNNs) are widely used to perform different machin...
research
03/23/2022

Graph Neural Networks in Particle Physics: Implementations, Innovations, and Challenges

Many physical systems can be best understood as sets of discrete data wi...
research
10/26/2020

GraphMDN: Leveraging graph structure and deep learning to solve inverse problems

The recent introduction of Graph Neural Networks (GNNs) and their growin...
research
05/10/2023

Graph Neural Networks and 3-Dimensional Topology

We test the efficiency of applying Geometric Deep Learning to the proble...
research
01/28/2022

RiskNet: Neural Risk Assessment in Networks of Unreliable Resources

We propose a graph neural network (GNN)-based method to predict the dist...
research
11/16/2018

Pre-training Graph Neural Networks with Kernels

Many machine learning techniques have been proposed in the last few year...

Please sign up or login with your details

Forgot password? Click here to reset