Sparsistent filtering of comovement networks from high-dimensional data

01/22/2021
by   Arnab Chakrabarti, et al.
0

Network filtering is an important form of dimension reduction to isolate the core constituents of large and interconnected complex systems. We introduce a new technique to filter large dimensional networks arising out of dynamical behavior of the constituent nodes, exploiting their spectral properties. As opposed to the well known network filters that rely on preserving key topological properties of the realized network, our method treats the spectrum as the fundamental object and preserves spectral properties. Applying asymptotic theory for high dimensional data for the filter, we show that it can be tuned to interpolate between zero filtering to maximal filtering that induces sparsity and consistency while having the least spectral distance from a linear shrinkage estimator. We apply our proposed filter to covariance networks constructed from financial data, to extract the key subnetwork embedded in the full sample network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/17/2015

Learning Sparse High Dimensional Filters: Image Filtering, Dense CRFs and Bilateral Neural Networks

Bilateral filters have wide spread use due to their edge-preserving prop...
research
10/24/2018

Asymptotics of eigenstructure of sample correlation matrices for high-dimensional spiked models

Sample correlation matrices are employed ubiquitously in statistics. How...
research
12/06/2020

Using topological autoencoders as a filtering function for global and local topology

Choosing a suitable filtering function for the Mapper algorithm can be d...
research
03/23/2020

On Consistency and Sparsity for High-Dimensional Functional Time Series with Application to Autoregressions

Modelling a large collection of functional time series arises in a broad...
research
04/14/2021

Towards an Interpretable Data-driven Trigger System for High-throughput Physics Facilities

Data-intensive science is increasingly reliant on real-time processing c...
research
07/21/2020

Spectral estimation from simulations via sketching

Sketching is a stochastic dimension reduction method that preserves geom...
research
01/29/2022

Convolutional Filtering in Simplicial Complexes

This paper proposes convolutional filtering for data whose structure can...

Please sign up or login with your details

Forgot password? Click here to reset