Analysis of Numerical Integration in RNN-Based Residuals for Fault Diagnosis of Dynamic Systems

05/08/2023
by   Arman Mohammadi, et al.
0

Data-driven modeling and machine learning are widely used to model the behavior of dynamic systems. One application is the residual evaluation of technical systems where model predictions are compared with measurement data to create residuals for fault diagnosis applications. While recurrent neural network models have been shown capable of modeling complex non-linear dynamic systems, they are limited to fixed steps discrete-time simulation. Modeling using neural ordinary differential equations, however, make it possible to evaluate the state variables at specific times, compute gradients when training the model and use standard numerical solvers to explicitly model the underlying dynamic of the time-series data. Here, the effect of solver selection on the performance of neural ordinary differential equation residuals during training and evaluation is investigated. The paper includes a case study of a heavy-duty truck's after-treatment system to highlight the potential of these techniques for improving fault diagnosis performance.

READ FULL TEXT
research
05/20/2020

Neural Ordinary Differential Equation based Recurrent Neural Network Model

Neural differential equations are a promising new member in the neural n...
research
07/03/2020

DynNet: Physics-based neural architecture design for linear and nonlinear structural response modeling and prediction

Data-driven models for predicting dynamic responses of linear and nonlin...
research
06/02/2023

Neural Differential Recurrent Neural Network with Adaptive Time Steps

The neural Ordinary Differential Equation (ODE) model has shown success ...
research
08/11/2020

Residual Generation Using Physically-Based Grey-Box Recurrent Neural Networks For Engine Fault Diagnosis

Data-driven fault diagnosis is complicated by unknown fault classes and ...
research
02/26/2023

Invariant Neural Ordinary Differential Equations

Latent neural ordinary differential equations have been proven useful fo...
research
04/21/2022

Physical Modeling using Recurrent Neural Networks with Fast Convolutional Layers

Discrete-time modeling of acoustic, mechanical and electrical systems is...
research
08/08/2020

A novel residual whitening based training to avoid overfitting

In this paper we demonstrate that training models to minimize the autoco...

Please sign up or login with your details

Forgot password? Click here to reset