Approximation with Tensor Networks. Part III: Multivariate Approximation

01/28/2021
by   Mazen Ali, et al.
0

We study the approximation of multivariate functions with tensor networks (TNs). The main conclusion of this work is an answer to the following two questions: "What are the approximation capabilities of TNs?" and "What is an appropriate model class of functions that can be approximated with TNs?" To answer the former: we show that TNs can (near to) optimally replicate h-uniform and h-adaptive approximation, for any smoothness order of the target function. Tensor networks thus exhibit universal expressivity w.r.t. isotropic, anisotropic and mixed smoothness spaces that is comparable with more general neural networks families such as deep rectified linear unit (ReLU) networks. Put differently, TNs have the capacity to (near to) optimally approximate many function classes – without being adapted to the particular class in question. To answer the latter: as a candidate model class we consider approximation classes of TNs and show that these are (quasi-)Banach spaces, that many types of classical smoothness spaces are continuously embedded into said approximation classes and that TN approximation classes are themselves not embedded in any classical smoothness space.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

06/30/2020

Approximation with Tensor Networks. Part II: Approximation Rates for Smoothness Classes

We study the approximation by tensor networks (TNs) of functions from cl...
07/30/2020

Approximation of Smoothness Classes by Deep ReLU Networks

We consider approximation rates of sparsely connected deep rectified lin...
06/30/2020

Approximation with Tensor Networks. Part I: Approximation Spaces

We study the approximation of functions by tensor networks (TNs). We sho...
05/03/2019

Approximation spaces of deep neural networks

We study the expressivity of deep neural networks. Measuring a network's...
03/30/2020

Numerical integration without smoothness assumption

We consider numerical integration in classes, for which we do not impose...
03/30/2021

Equivalence between Sobolev spaces of first-order dominating mixed smoothness and unanchored ANOVA spaces on ℝ^d

We prove that a variant of the classical Sobolev space of first-order do...
02/28/2020

Multivariate Haar systems in Besov function spaces

We determine all cases for which the d-dimensional Haar wavelet system H...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.