System Identification Through Lipschitz Regularized Deep Neural Networks

09/07/2020
by   Elisa Negrini, et al.
18

In this paper we use neural networks to learn governing equations from data. Specifically we reconstruct the right-hand side of a system of ODEs ẋ(t) = f(t, x(t)) directly from observed uniformly time-sampled data using a neural network. In contrast with other neural network based approaches to this problem, we add a Lipschitz regularization term to our loss function. In the synthetic examples we observed empirically that this regularization results in a smoother approximating function and better generalization properties when compared with non-regularized models, both on trajectory and non-trajectory data, especially in presence of noise. In contrast with sparse regression approaches, since neural networks are universal approximators, we don't need any prior knowledge on the ODE system. Since the model is applied component wise, it can handle systems of any dimension, making it usable for real-world data.

READ FULL TEXT

page 15

page 19

page 30

page 31

page 32

page 33

page 34

page 35

research
10/15/2021

A Neural Network Ensemble Approach to System Identification

We present a new algorithm for learning unknown governing equations from...
research
08/28/2018

Lipschitz regularized Deep Neural Networks converge and generalize

Lipschitz regularized neural networks augment the usual fidelity term us...
research
04/11/2021

The Many Faces of 1-Lipschitz Neural Networks

Lipschitz constrained models have been used to solve specifics deep lear...
research
03/29/2023

Lipschitzness Effect of a Loss Function on Generalization Performance of Deep Neural Networks Trained by Adam and AdamW Optimizers

The generalization performance of deep neural networks with regard to th...
research
10/05/2022

Dynamical systems' based neural networks

Neural networks have gained much interest because of their effectiveness...
research
06/16/2021

Lorenz System State Stability Identification using Neural Networks

Nonlinear dynamical systems such as Lorenz63 equations are known to be c...
research
11/29/2019

Model structures and fitting criteria for system identification with neural networks

This paper focuses on the identification of dynamical systems with tailo...

Please sign up or login with your details

Forgot password? Click here to reset