Sparsistent filtering of comovement networks from high-dimensional data

01/22/2021
by   Arnab Chakrabarti, et al.
0

Network filtering is an important form of dimension reduction to isolate the core constituents of large and interconnected complex systems. We introduce a new technique to filter large dimensional networks arising out of dynamical behavior of the constituent nodes, exploiting their spectral properties. As opposed to the well known network filters that rely on preserving key topological properties of the realized network, our method treats the spectrum as the fundamental object and preserves spectral properties. Applying asymptotic theory for high dimensional data for the filter, we show that it can be tuned to interpolate between zero filtering to maximal filtering that induces sparsity and consistency while having the least spectral distance from a linear shrinkage estimator. We apply our proposed filter to covariance networks constructed from financial data, to extract the key subnetwork embedded in the full sample network.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

03/17/2015

Learning Sparse High Dimensional Filters: Image Filtering, Dense CRFs and Bilateral Neural Networks

Bilateral filters have wide spread use due to their edge-preserving prop...
12/06/2020

Using topological autoencoders as a filtering function for global and local topology

Choosing a suitable filtering function for the Mapper algorithm can be d...
03/23/2020

On Consistency and Sparsity for High-Dimensional Functional Time Series with Application to Autoregressions

Modelling a large collection of functional time series arises in a broad...
04/14/2021

Towards an Interpretable Data-driven Trigger System for High-throughput Physics Facilities

Data-intensive science is increasingly reliant on real-time processing c...
07/21/2020

Spectral estimation from simulations via sketching

Sketching is a stochastic dimension reduction method that preserves geom...
03/07/2021

Cascaded Filtering Using the Sigma Point Transformation (Extended Version)

It is often convenient to separate a state estimation task into smaller ...
10/15/2018

Exploratory Mediation Analysis with Many Potential Mediators

Social and behavioral scientists are increasingly employing technologies...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.