A General Algorithm for Solving Rank-one Matrix Sensing

03/22/2023
by   Lianke Qin, et al.
0

Matrix sensing has many real-world applications in science and engineering, such as system control, distance embedding, and computer vision. The goal of matrix sensing is to recover a matrix A_⋆∈ℝ^n × n, based on a sequence of measurements (u_i,b_i) ∈ℝ^n×ℝ such that u_i^⊤ A_⋆ u_i = b_i. Previous work [ZJD15] focused on the scenario where matrix A_⋆ has a small rank, e.g. rank-k. Their analysis heavily relies on the RIP assumption, making it unclear how to generalize to high-rank matrices. In this paper, we relax that rank-k assumption and solve a much more general matrix sensing problem. Given an accuracy parameter δ∈ (0,1), we can compute A ∈ℝ^n × n in O(m^3/2 n^2 δ^-1 ), such that |u_i^⊤ A u_i - b_i| ≤δ for all i ∈ [m]. We design an efficient algorithm with provable convergence guarantees using stochastic gradient descent for this problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/13/2023

An Improved Sample Complexity for Rank-1 Matrix Sensing

Matrix sensing is a problem in signal processing and machine learning th...
research
01/13/2021

Beyond Procrustes: Balancing-Free Gradient Descent for Asymmetric Low-Rank Matrix Sensing

Low-rank matrix estimation plays a central role in various applications ...
research
03/24/2023

Implicit Balancing and Regularization: Generalization and Convergence Guarantees for Overparameterized Asymmetric Matrix Sensing

Recently, there has been significant progress in understanding the conve...
research
03/13/2022

On the analysis of optimization with fixed-rank matrices: a quotient geometric view

We study a type of Riemannian gradient descent (RGD) algorithm, designed...
research
09/07/2023

Low-rank Matrix Sensing With Dithered One-Bit Quantization

We explore the impact of coarse quantization on low-rank matrix sensing ...
research
01/27/2021

On the computational and statistical complexity of over-parameterized matrix sensing

We consider solving the low rank matrix sensing problem with Factorized ...
research
08/21/2016

A Non-convex One-Pass Framework for Generalized Factorization Machine and Rank-One Matrix Sensing

We develop an efficient alternating framework for learning a generalized...

Please sign up or login with your details

Forgot password? Click here to reset