Causal Matrix Completion

09/30/2021
by   Anish Agarwal, et al.
10

Matrix completion is the study of recovering an underlying matrix from a sparse subset of noisy observations. Traditionally, it is assumed that the entries of the matrix are "missing completely at random" (MCAR), i.e., each entry is revealed at random, independent of everything else, with uniform probability. This is likely unrealistic due to the presence of "latent confounders", i.e., unobserved factors that determine both the entries of the underlying matrix and the missingness pattern in the observed matrix. For example, in the context of movie recommender systems – a canonical application for matrix completion – a user who vehemently dislikes horror films is unlikely to ever watch horror films. In general, these confounders yield "missing not at random" (MNAR) data, which can severely impact any inference procedure that does not correct for this bias. We develop a formal causal model for matrix completion through the language of potential outcomes, and provide novel identification arguments for a variety of causal estimands of interest. We design a procedure, which we call "synthetic nearest neighbors" (SNN), to estimate these causal estimands. We prove finite-sample consistency and asymptotic normality of our estimator. Our analysis also leads to new theoretical results for the matrix completion literature. In particular, we establish entry-wise, i.e., max-norm, finite-sample consistency and asymptotic normality results for matrix completion with MNAR data. As a special case, this also provides entry-wise bounds for matrix completion with MCAR data. Across simulated and real data, we demonstrate the efficacy of our proposed estimator.

READ FULL TEXT
research
05/10/2016

A note on the statistical view of matrix completion

A very simple interpretation of matrix completion problem is introduced ...
research
05/04/2021

A Note on Statistical Inference for Noisy Incomplete 1-Bit Matrix

We consider the statistical inference for noisy incomplete 1-bit matrix....
research
06/07/2023

Exploiting Observation Bias to Improve Matrix Completion

We consider a variant of matrix completion where entries are revealed in...
research
08/31/2019

Statistical Inferences of Linear Forms for Noisy Matrix Completion

We introduce a flexible framework for making inferences about general li...
research
08/04/2023

Matrix Completion When Missing Is Not at Random and Its Applications in Causal Panel Data Models

This paper develops an inferential framework for matrix completion when ...
research
09/17/2020

Bayesian Matrix Completion for Hypothesis Testing

The United States Environmental Protection Agency (EPA) screens thousand...
research
05/12/2020

Detection thresholds in very sparse matrix completion

Let A be a rectangular matrix of size m× n and A_1 be the random matrix ...

Please sign up or login with your details

Forgot password? Click here to reset