Frequency-Supported Neural Networks for Nonlinear Dynamical System Identification

05/10/2023
by   Krzysztof Zając, et al.
0

Neural networks are a very general type of model capable of learning various relationships between multiple variables. One example of such relationships, particularly interesting in practice, is the input-output relation of nonlinear systems, which has a multitude of applications. Studying models capable of estimating such relation is a broad discipline with numerous theoretical and practical results. Neural networks are very general, but multiple special cases exist, including convolutional neural networks and recurrent neural networks, which are adjusted for specific applications, which are image and sequence processing respectively. We formulate a hypothesis that adjusting general network structure by incorporating frequency information into it should result in a network specifically well suited to nonlinear system identification. Moreover, we show that it is possible to add this frequency information without the loss of generality from a theoretical perspective. We call this new structure Frequency-Supported Neural Network (FSNN) and empirically investigate its properties.

READ FULL TEXT

page 8

page 9

research
10/05/2016

Nonlinear Systems Identification Using Deep Dynamic Neural Networks

Neural networks are known to be effective function approximators. Recent...
research
05/30/2023

Inverse Approximation Theory for Nonlinear Recurrent Neural Networks

We prove an inverse approximation theorem for the approximation of nonli...
research
04/11/2020

Convex Sets of Robust Recurrent Neural Networks

Recurrent neural networks (RNNs) are a class of nonlinear dynamical syst...
research
05/15/2019

Efficient hinging hyperplanes neural network and its application in nonlinear system identification

In this paper, the efficient hinging hyperplanes (EHH) neural network is...
research
11/21/2019

System Identification with Time-Aware Neural Sequence Models

Established recurrent neural networks are well-suited to solve a wide va...
research
06/11/2019

Dynamical Anatomy of NARMA10 Benchmark Task

The emulation task of a nonlinear autoregressive moving average model, i...
research
11/08/2021

The Global Structure of Codimension-2 Local Bifurcations in Continuous-Time Recurrent Neural Networks

If we are ever to move beyond the study of isolated special cases in the...

Please sign up or login with your details

Forgot password? Click here to reset