Solving weakly supervised regression problem using low-rank manifold regularization

04/13/2021
by   Vladimir Berikov, et al.
0

We solve a weakly supervised regression problem. Under "weakly" we understand that for some training points the labels are known, for some unknown, and for others uncertain due to the presence of random noise or other reasons such as lack of resources. The solution process requires to optimize a certain objective function (the loss function), which combines manifold regularization and low-rank matrix decomposition techniques. These low-rank approximations allow us to speed up all matrix calculations and reduce storage requirements. This is especially crucial for large datasets. Ensemble clustering is used for obtaining the co-association matrix, which we consider as the similarity matrix. The utilization of these techniques allows us to increase the quality and stability of the solution. In the numerical section, we applied the suggested method to artificial and real datasets using Monte-Carlo modeling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/13/2019

Semi-Supervised Regression using Cluster Ensemble and Low-Rank Co-Association Matrix Decomposition under Uncertainties

In this paper, we solve a semi-supervised regression problem. Due to the...
research
05/30/2017

Sparse and low-rank approximations of large symmetric matrices using biharmonic interpolation

Symmetric matrices are widely used in machine learning problems such as ...
research
08/01/2017

Robust PCA by Manifold Optimization

Robust PCA is a widely used statistical procedure to recover a underlyin...
research
08/27/2020

Implicit Regularization in Matrix Sensing: A Geometric View Leads to Stronger Results

We may think of low-rank matrix sensing as a learning problem with infin...
research
03/11/2019

Revisiting clustering as matrix factorisation on the Stiefel manifold

This paper studies clustering for possibly high dimensional data (e.g. i...
research
08/01/2023

Learning Green's Function Efficiently Using Low-Rank Approximations

Learning the Green's function using deep learning models enables to solv...

Please sign up or login with your details

Forgot password? Click here to reset