Forward and Inverse Approximation Theory for Linear Temporal Convolutional Networks

05/29/2023
by   Haotian Jiang, et al.
0

We present a theoretical analysis of the approximation properties of convolutional architectures when applied to the modeling of temporal sequences. Specifically, we prove an approximation rate estimate (Jackson-type result) and an inverse approximation theorem (Bernstein-type result), which together provide a comprehensive characterization of the types of sequential relationships that can be efficiently captured by a temporal convolutional architecture. The rate estimate improves upon a previous result via the introduction of a refined complexity measure, whereas the inverse approximation theorem is new.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2023

Inverse Approximation Theory for Nonlinear Recurrent Neural Networks

We prove an inverse approximation theorem for the approximation of nonli...
research
09/15/2019

Direct and inverse results for Kantorovich type exponential sampling series

In this article, we analyze the behaviour of the new family of Kantorovi...
research
05/29/2023

Approximation theory of transformer networks for sequence modeling

The transformer is a widely applied architecture in sequence modeling ap...
research
09/28/2022

Quantitative Khintchine in Simultaneous Approximation

In a ground-breaking work <cit.>, Beresnevich and Yang recently proved K...
research
07/20/2021

Approximation Theory of Convolutional Architectures for Time Series Modelling

We study the approximation properties of convolutional architectures app...
research
06/03/2022

Polynomial approximation on C^2-domains

We introduce appropriate computable moduli of smoothness to characterize...
research
07/27/2022

Cubic Goldreich-Levin

In this paper, we give a cubic Goldreich-Levin algorithm which makes pol...

Please sign up or login with your details

Forgot password? Click here to reset