A critical look at deep neural network for dynamic system modeling

01/27/2023
by   Jinming Zhou, et al.
0

Neural network models become increasingly popular as dynamic modeling tools in the control community. They have many appealing features including nonlinear structures, being able to approximate any functions. While most researchers hold optimistic attitudes towards such models, this paper questions the capability of (deep) neural networks for the modeling of dynamic systems using input-output data. For the identification of linear time-invariant (LTI) dynamic systems, two representative neural network models, Long Short-Term Memory (LSTM) and Cascade Foward Neural Network (CFNN) are compared to the standard Prediction Error Method (PEM) of system identification. In the comparison, four essential aspects of system identification are considered, then several possible defects and neglected issues of neural network based modeling are pointed out. Detailed simulation studies are performed to verify these defects: for the LTI system, both LSTM and CFNN fail to deliver consistent models even in noise-free cases; and they give worse results than PEM in noisy cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/06/2022

Deep transfer learning for system identification using long short-term memory neural networks

Recurrent neural networks (RNNs) have many advantages over more traditio...
research
04/06/2023

Deep Long-Short Term Memory networks: Stability properties and Experimental validation

The aim of this work is to investigate the use of Incrementally Input-to...
research
12/22/2019

On the Initialization of Long Short-Term Memory Networks

Weight initialization is important for faster convergence and stability ...
research
08/11/2019

Data-Driven Predictive Modeling of Neuronal Dynamics using Long Short-Term Memory

Modeling brain dynamics to better understand and control complex behavio...
research
04/26/2020

Cascade-LSTM: Predicting Information Cascades using Deep Neural Networks

Predicting the flow of information in dynamic social environments is rel...
research
03/02/2022

Predicting the temporal dynamics of turbulent channels through deep learning

The success of recurrent neural networks (RNNs) has been demonstrated in...
research
11/14/2017

SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring

Deep learning has demonstrated tremendous potential for Automatic Text S...

Please sign up or login with your details

Forgot password? Click here to reset