Matrix Completion for Survey Data Prediction with Multivariate Missingness

07/19/2019
by   Xiaojun Mao, et al.
0

Survey data are the gold-standard for estimating finite population parameters, which, however, become challenging due to inevitable missingness. In this paper, we develop a new imputation method to deal with multivariate missingness at random using matrix completion. In contrast to existing imputation schemes either conducting row-wise or column-wise imputation, we treat the data matrix as a whole which allows to exploit both row and column patterns at the same time. We adopt a column-space-decomposition model for the population data matrix with easy-to-obtain demographic data as covariates and a low-rank structured residual matrix. The proposed method addresses identification and penalized estimation for the sample data matrix. Asymptotic properties are investigated, and simulation study shows that the doubly robust estimator using the proposed matrix completion for imputation has smaller mean squared error than other competitors. We apply the proposed method to the National Health and Nutrition Examination Survey 2015-2016 Questionnaire Data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/18/2016

Going off the Grid: Iterative Model Selection for Biclustered Matrix Completion

We consider the problem of performing matrix completion with side inform...
research
01/05/2020

Matrix Completion with Prior Subspace Information via Maximizing Correlation

This paper studies the problem of completing a low-rank matrix from a fe...
research
06/07/2023

Improving Survey Inference in Two-phase Designs Using Bayesian Machine Learning

The two-phase sampling design is a cost-effective sampling strategy that...
research
05/21/2021

BELT: Block-wise Missing Embedding Learning Transformer

Matrix completion has attracted attention in many fields, including stat...
research
12/03/2020

Matrix Completion Methods for the Total Electron Content Video Reconstruction

The total electron content (TEC) maps can be used to estimate the signal...
research
06/01/2021

Retrospective causal inference via matrix completion, with an evaluation of the effect of European integration on cross-border employment

We propose a method of retrospective counterfactual imputation in panel ...
research
09/03/2022

Estimating Demand for Online Delivery using Limited Historical Observations

Driven in part by the COVID-19 pandemic, the pace of online purchases fo...

Please sign up or login with your details

Forgot password? Click here to reset