Robust Regularized Low-Rank Matrix Models for Regression and Classification

05/14/2022
by   Hsin-Hsiung Huang, et al.
0

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy matrix-valued predictors. To address these issues, this paper proposes a framework of matrix variate regression models based on a rank constraint, vector regularization (e.g., sparsity), and a general loss function with three special cases considered: ordinary matrix regression, robust matrix regression, and matrix logistic regression. We also propose an alternating projected gradient descent algorithm. Based on analyzing our objective functions on manifolds with bounded curvature, we show that the algorithm is guaranteed to converge, all accumulation points of the iterates have estimation errors in the order of O(1/√(n)) asymptotically and substantially attaining the minimax rate. Our theoretical analysis can be applied to general optimization problems on manifolds with bounded curvature and can be considered an important technical contribution to this work. We validate the proposed method through simulation studies and real image data examples.

READ FULL TEXT

page 10

page 13

page 18

research
10/17/2016

A Unified Computational and Statistical Framework for Nonconvex Low-Rank Matrix Estimation

We propose a unified framework for estimating low-rank matrices through ...
research
05/31/2021

A Minimax Lower Bound for Low-Rank Matrix-Variate Logistic Regression

This paper considers the problem of matrix-variate logistic regression. ...
research
12/10/2020

Low-rank matrix estimation in multi-response regression with measurement errors: Statistical and computational guarantees

In this paper, we investigate the matrix estimation problem in the multi...
research
11/09/2022

A Unified Analysis of Multi-task Functional Linear Regression Models with Manifold Constraint and Composite Quadratic Penalty

This work studies the multi-task functional linear regression models whe...
research
09/10/2015

Fast low-rank estimation by projected gradient descent: General statistical and algorithmic guarantees

Optimization problems with rank constraints arise in many applications, ...
research
01/28/2021

Robust Extrinsic Regression Analysis for Manifold Valued Data

Recently, there has been a growing need in analyzing data on manifolds o...
research
01/13/2022

Statistically Optimal First Order Algorithms: A Proof via Orthogonalization

We consider a class of statistical estimation problems in which we are g...

Please sign up or login with your details

Forgot password? Click here to reset