Enhanced Nonlinear System Identification by Interpolating Low-Rank Tensors

02/15/2023
by   Christina Auer, et al.
0

Function approximation from input and output data is one of the most investigated problems in signal processing. This problem has been tackled with various signal processing and machine learning methods. Although tensors have a rich history upon numerous disciplines, tensor-based estimation has recently become of particular interest in system identification. In this paper we focus on the problem of adaptive nonlinear system identification solved with interpolated tensor methods. We introduce three novel approaches where we combine the existing tensor-based estimation techniques with multidimensional linear interpolation. To keep the reduced complexity, we stick to the concept where the algorithms employ a Wiener or Hammerstein structure and the tensors are combined with the well-known LMS algorithm. The update of the tensor is based on a stochastic gradient decent concept. Moreover, an appropriate step size normalization for the update of the tensors and the LMS supports the convergence. Finally, in several experiments we show that the proposed algorithms almost always clearly outperform the state-of-the-art methods with lower or comparable complexity.

READ FULL TEXT

page 1

page 10

page 12

research
09/25/2017

Best Rank-One Tensor Approximation and Parallel Update Algorithm for CPD

A novel algorithm is proposed for CANDECOMP/PARAFAC tensor decomposition...
research
07/06/2016

Tensor Decomposition for Signal Processing and Machine Learning

Tensors or multi-way arrays are functions of three or more indices (i,j...
research
04/27/2017

Multiscale Analysis for Higher-order Tensors

The widespread use of multisensor technology and the emergence of big da...
research
09/26/2019

Crowdsourcing via Pairwise Co-occurrences: Identifiability and Algorithms

The data deluge comes with high demands for data labeling. Crowdsourcing...
research
06/08/2015

Convex recovery of tensors using nuclear norm penalization

The subdifferential of convex functions of the singular spectrum of real...
research
11/29/2017

Introduction to Tensor Decompositions and their Applications in Machine Learning

Tensors are multidimensional arrays of numerical values and therefore ge...
research
06/28/2018

Sparse Sampling for Inverse Problems with Tensors

We consider the problem of designing sparse sampling strategies for mult...

Please sign up or login with your details

Forgot password? Click here to reset