A least-squares method for sparse low rank approximation of multivariate functions

04/30/2013
by   Mathilde Chevreuil, et al.
0

In this paper, we propose a low-rank approximation method based on discrete least-squares for the approximation of a multivariate function from random, noisy-free observations. Sparsity inducing regularization techniques are used within classical algorithms for low-rank approximation in order to exploit the possible sparsity of low-rank approximations. Sparse low-rank approximations are constructed with a robust updated greedy algorithm which includes an optimal selection of regularization parameters and approximation ranks using cross validation techniques. Numerical examples demonstrate the capability of approximating functions of many variables even when very few function evaluations are available, thus proving the interest of the proposed algorithm for the propagation of uncertainties through complex computational models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2017

Nonsmooth Frank-Wolfe using Uniform Affine Approximations

Frank-Wolfe methods (FW) have gained significant interest in the machine...
research
12/08/2019

The AZ algorithm for least squares systems with a known incomplete generalized inverse

We introduce an algorithm for the least squares solution of a rectangula...
research
12/30/2018

On Cross-validation for Sparse Reduced Rank Regression

In high-dimensional data analysis, regularization methods pursuing spars...
research
08/24/2020

Approximate Cross-Validation with Low-Rank Data in High Dimensions

Many recent advances in machine learning are driven by a challenging tri...
research
10/28/2021

Scatterbrain: Unifying Sparse and Low-rank Attention Approximation

Recent advances in efficient Transformers have exploited either the spar...
research
06/22/2023

Generalized Low-Rank Update: Model Parameter Bounds for Low-Rank Training Data Modifications

In this study, we have developed an incremental machine learning (ML) me...
research
01/29/2019

Sparse Least Squares Low Rank Kernel Machines

A general framework of least squares support vector machine with low ran...

Please sign up or login with your details

Forgot password? Click here to reset