Conformalized matrix completion

05/18/2023
by   Yu Gui, et al.
0

Matrix completion aims to estimate missing entries in a data matrix, using the assumption of a low-complexity structure (e.g., low rank) so that imputation is possible. While many effective estimation algorithms exist in the literature, uncertainty quantification for this problem has proved to be challenging, and existing methods are extremely sensitive to model misspecification. In this work, we propose a distribution-free method for predictive inference in the matrix completion problem. Our method adapts the framework of conformal prediction, which provides confidence intervals with guaranteed distribution-free validity in the setting of regression, to the problem of matrix completion. Our resulting method, conformalized matrix completion (cmc), offers provable predictive coverage regardless of the accuracy of the low-rank model. Empirical results on simulated and real data demonstrate that cmc is robust to model misspecification while matching the performance of existing model-based methods when the model is correct.

READ FULL TEXT
research
04/27/2023

A Majorization-Minimization Gauss-Newton Method for 1-Bit Matrix Completion

In 1-bit matrix completion, the aim is to estimate an underlying low-ran...
research
06/18/2020

Matrix Completion with Quantified Uncertainty through Low Rank Gaussian Copula

Modern large scale datasets are often plagued with missing entries; inde...
research
10/31/2016

Temporal Matrix Completion with Locally Linear Latent Factors for Medical Applications

Regular medical records are useful for medical practitioners to analyze ...
research
08/03/2020

Uncertainty Quantification of Structural Systems with Subset of Data

Quantification of the impact of uncertainty in material properties as we...
research
12/03/2020

Matrix Completion Methods for the Total Electron Content Video Reconstruction

The total electron content (TEC) maps can be used to estimate the signal...
research
05/05/2015

Prediction and Quantification of Individual Athletic Performance

We provide scientific foundations for athletic performance prediction on...
research
12/29/2018

Imputation and low-rank estimation with Missing Non At Random data

Missing values challenge data analysis because many supervised and unsu-...

Please sign up or login with your details

Forgot password? Click here to reset