Confounder Detection in High Dimensional Linear Models using First Moments of Spectral Measures

03/19/2018
by   Furui Liu, et al.
0

In this paper, we study the confounder detection problem in the linear model, where the target variable Y is predicted using its n potential causes X_n=(x_1,...,x_n)^T. Based on an assumption of rotation invariant generating process of the model, recent study shows that the spectral measure induced by the regression coefficient vector with respect to the covariance matrix of X_n is close to a uniform measure in purely causal cases, but it differs from a uniform measure characteristically in the presence of a scalar confounder. Then, analyzing spectral measure pattern could help to detect confounding. In this paper, we propose to use the first moment of the spectral measure for confounder detection. We calculate the first moment of the regression vector induced spectral measure, and compare it with the first moment of a uniform spectral measure, both defined with respect to the covariance matrix of X_n. The two moments coincide in non-confounding cases, and differ from each other in the presence of confounding. This statistical causal-confounding asymmetry can be used for confounder detection. Without the need of analyzing the spectral measure pattern, our method does avoid the difficulty of metric choice and multiple parameter optimization. Experiments on synthetic and real data show the performance of this method.

READ FULL TEXT
research
04/05/2017

Detecting confounding in multivariate linear models via spectral analysis

We study a model where one target variable Y is correlated with a vector...
research
03/02/2018

Detecting non-causal artifacts in multivariate linear regression models

We consider linear models where d potential causes X_1,...,X_d are corre...
research
11/13/2018

Spectral Deconfounding and Perturbed Sparse Linear Models

Standard high-dimensional regression methods assume that the underlying ...
research
11/01/2022

Instrumental Processes Using Integrated Covariances

Instrumental variable methods are often used for parameter estimation in...
research
05/22/2023

Covariance Estimation under Missing Observations and L_4-L_2 Moment Equivalence

We consider the problem of estimating the covariance matrix of a random ...
research
06/17/2020

A Concentration of Measure and Random Matrix Approach to Large Dimensional Robust Statistics

This article studies the robust covariance matrix estimation of a data c...
research
10/02/2022

Exact first moments of the RV coefficient by invariant orthogonal integration

The RV coefficient measures the similarity between two multivariate conf...

Please sign up or login with your details

Forgot password? Click here to reset