Low-rank data modeling via the Minimum Description Length principle

09/28/2011
by   Ignacio Ramírez, et al.
0

Robust low-rank matrix estimation is a topic of increasing interest, with promising applications in a variety of fields, from computer vision to data mining and recommender systems. Recent theoretical results establish the ability of such data models to recover the true underlying low-rank matrix when a large portion of the measured matrix is either missing or arbitrarily corrupted. However, if low rank is not a hypothesis about the true nature of the data, but a device for extracting regularity from it, no current guidelines exist for choosing the rank of the estimated matrix. In this work we address this problem by means of the Minimum Description Length (MDL) principle -- a well established information-theoretic approach to statistical inference -- as a guideline for selecting a model for the data at hand. We demonstrate the practical usefulness of our formal approach with results for complex background extraction in video sequences.

READ FULL TEXT
research
09/17/2020

Low-Rank Matrix Recovery from Noisy via an MDL Framework-based Atomic Norm

The recovery of the underlying low-rank structure of clean data corrupte...
research
10/11/2011

An MDL framework for sparse coding and dictionary learning

The power of sparse signal modeling with learned over-complete dictionar...
research
12/06/2019

Model Order Reduction of Combustion Processes with Complex Front Dynamics

In this work we present a data driven method, used to improve mode-based...
research
10/19/2018

False Discovery and Its Control in Low Rank Estimation

Models specified by low-rank matrices are ubiquitous in contemporary app...
research
09/22/2021

Weighted Low Rank Matrix Approximation and Acceleration

Low-rank matrix approximation is one of the central concepts in machine ...
research
12/08/2017

Maximum entropy low-rank matrix recovery

We propose a novel, information-theoretic method, called MaxEnt, for eff...
research
11/30/2022

Robust and Fast Measure of Information via Low-rank Representation

The matrix-based Rényi's entropy allows us to directly quantify informat...

Please sign up or login with your details

Forgot password? Click here to reset