Understanding the Basis of Graph Convolutional Neural Networks via an Intuitive Matched Filtering Approach

08/23/2021
by   Ljubisa Stankovic, et al.
0

Graph Convolutional Neural Networks (GCNN) are becoming a preferred model for data processing on irregular domains, yet their analysis and principles of operation are rarely examined due to the black box nature of NNs. To this end, we revisit the operation of GCNNs and show that their convolution layers effectively perform matched filtering of input data with the chosen patterns (features). This allows us to provide a unifying account of GCNNs through a matched filter perspective, whereby the nonlinear ReLU and max-pooling layers are also discussed within the matched filtering framework. This is followed by a step-by-step guide on information propagation and learning in GCNNs. It is also shown that standard CNNs and fully connected NNs can be obtained as a special case of GCNNs. A carefully chosen numerical example guides the reader through the various steps of GCNN operation and learning both visually and numerically.

READ FULL TEXT

page 5

page 11

research
08/26/2021

Convolutional Neural Networks Demystified: A Matched Filtering Perspective Based Tutorial

Deep Neural Networks (DNN) and especially Convolutional Neural Networks ...
research
10/16/2022

Demystifying CNNs for Images by Matched Filters

The success of convolution neural networks (CNN) has been revolutionisin...
research
03/31/2019

Clique pooling for graph classification

We propose a novel graph pooling operation using cliques as the unit poo...
research
07/23/2022

Boosting the Efficiency of Parametric Detection with Hierarchical Neural Networks

Gravitational wave astronomy is a vibrant field that leverages both clas...
research
09/21/2018

Analysis of Irregular Spatial Data with Machine Learning: Classification of Building Patterns with a Graph Convolutional Neural Network

Machine learning methods such as convolutional neural networks (CNNs) ar...
research
12/08/2018

Signal recognition and background suppression by matched filters and neural networks for Tunka-Rex

The Tunka Radio Extension (Tunka-Rex) is a digital antenna array, which ...
research
04/12/2020

Minimal Filtering Algorithms for Convolutional Neural Networks

In this paper, we present several resource-efficient algorithmic solutio...

Please sign up or login with your details

Forgot password? Click here to reset