A block-sparse Tensor Train Format for sample-efficient high-dimensional Polynomial Regression

04/29/2021
by   Michael Götte, et al.
0

Low-rank tensors are an established framework for high-dimensional least-squares problems. We propose to extend this framework by including the concept of block-sparsity. In the context of polynomial regression each sparsity pattern corresponds to some subspace of homogeneous multivariate polynomials. This allows us to adapt the ansatz space to align better with known sample complexity results. The resulting method is tested in numerical experiments and demonstrates improved computational resource utilization and sample efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/31/2023

Dynamical low-rank tensor approximations to high-dimensional parabolic problems: existence and convergence of spatial discretizations

We consider dynamical low-rank approximations to parabolic problems on h...
research
02/08/2022

Optimal Evaluation of Symmetry-Adapted n-Correlations Via Recursive Contraction of Sparse Symmetric Tensors

We present a comprehensive analysis of an algorithm for evaluating high-...
research
02/16/2023

Reducing Computational and Statistical Complexity in Machine Learning Through Cardinality Sparsity

High-dimensional data has become ubiquitous across the sciences but caus...
research
12/20/2016

Parallelized Tensor Train Learning of Polynomial Classifiers

In pattern classification, polynomial classifiers are well-studied metho...
research
03/02/2021

Pricing high-dimensional Bermudan options with hierarchical tensor formats

An efficient compression technique based on hierarchical tensors for pop...
research
11/29/2021

Rank-Constrained Least-Squares: Prediction and Inference

In this work, we focus on the high-dimensional trace regression model wi...
research
08/11/2021

Convergence bounds for nonlinear least squares and applications to tensor recovery

We consider the problem of approximating a function in general nonlinear...

Please sign up or login with your details

Forgot password? Click here to reset