False Discovery and Its Control in Low Rank Estimation

10/19/2018
by   Armeen Taeb, et al.
0

Models specified by low-rank matrices are ubiquitous in contemporary applications. In many of these problem domains, the row/column space structure of a low-rank matrix carries information about some underlying phenomenon, and it is of interest in inferential settings to evaluate the extent to which the row/column spaces of an estimated low-rank matrix signify discoveries about the phenomenon. However, in contrast to variable selection, we lack a formal framework to assess true/false discoveries in low-rank estimation; in particular, the key source of difficulty is that the standard notion of a discovery is a discrete one that is ill-suited to the smooth structure underlying low-rank matrices. We address this challenge via a geometric reformulation of the concept of a discovery, which then enables a natural definition in the low-rank case. We describe and analyze a generalization of the Stability Selection method of Meinshausen and Bühlmann to control for false discoveries in low-rank estimation, and we demonstrate its utility compared to previous approaches via numerical experiments.

READ FULL TEXT

page 13

page 18

research
03/22/2019

CUR Decompositions, Approximations, and Perturbations

This article discusses a useful tool in dimensionality reduction and low...
research
08/01/2017

Robust PCA by Manifold Optimization

Robust PCA is a widely used statistical procedure to recover a underlyin...
research
06/26/2018

Main effects and interactions in mixed and incomplete data frames

A mixed data frame (MDF) is a table collecting categorical, numerical an...
research
09/06/2016

Law of Large Graphs

Estimating the mean of a population of graphs based on a sample is a cor...
research
09/28/2011

Low-rank data modeling via the Minimum Description Length principle

Robust low-rank matrix estimation is a topic of increasing interest, wit...
research
11/19/2021

Uncertainty-aware Low-Rank Q-Matrix Estimation for Deep Reinforcement Learning

Value estimation is one key problem in Reinforcement Learning. Albeit ma...
research
08/18/2022

Matrix Quantile Factor Model

In this paper, we introduce a matrix quantile factor model for matrix se...

Please sign up or login with your details

Forgot password? Click here to reset