coVariance Neural Networks

05/31/2022
by   Saurabh Sihag, et al.
0

Graph neural networks (GNN) are an effective framework that exploit inter-relationships within graph-structured data for learning. Principal component analysis (PCA) involves the projection of data on the eigenspace of the covariance matrix and draws similarities with the graph convolutional filters in GNNs. Motivated by this observation, we propose a GNN architecture, called coVariance neural network (VNN), that operates on sample covariance matrices as graphs. We theoretically establish the stability of VNNs to perturbations in the covariance matrix, thus, implying an advantage over standard PCA-based data analysis approaches that are prone to instability due to principal components associated with close eigenvalues. Our experiments on real-world datasets validate our theoretical results and show that VNN performance is indeed more stable than PCA-based statistical approaches. Moreover, our experiments on multi-resolution datasets also demonstrate that VNNs are amenable to transferability of performance over covariance matrices of different dimensions; a feature that is infeasible for PCA-based approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2022

Covariance matrix preparation for quantum principal component analysis

Principal component analysis (PCA) is a dimensionality reduction method ...
research
05/02/2023

Transferability of coVariance Neural Networks and Application to Interpretable Brain Age Prediction using Anatomical Features

Graph convolutional networks (GCN) leverage topology-driven graph convol...
research
05/31/2019

Diagonally-Dominant Principal Component Analysis

We consider the problem of decomposing a large covariance matrix into th...
research
10/08/2018

Find the dimension that counts: Fast dimension estimation and Krylov PCA

High dimensional data and systems with many degrees of freedom are often...
research
05/27/2023

Improved Privacy-Preserving PCA Using Space-optimized Homomorphic Matrix Multiplication

Principal Component Analysis (PCA) is a pivotal technique in the fields ...
research
12/23/2015

Multi-centrality Graph Spectral Decompositions and their Application to Cyber Intrusion Detection

Many modern datasets can be represented as graphs and hence spectral dec...
research
07/10/2014

An eigenanalysis of data centering in machine learning

Many pattern recognition methods rely on statistical information from ce...

Please sign up or login with your details

Forgot password? Click here to reset