Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networks

03/03/2023
by   Katarzyna Michałowska, et al.
0

Deep neural networks are an attractive alternative for simulating complex dynamical systems, as in comparison to traditional scientific computing methods, they offer reduced computational costs during inference and can be trained directly from observational data. Existing methods, however, cannot extrapolate accurately and are prone to error accumulation in long-time integration. Herein, we address this issue by combining neural operators with recurrent neural networks to construct a novel and effective architecture, resulting in superior accuracy compared to the state-of-the-art. The new hybrid model is based on operator learning while offering a recurrent structure to capture temporal dependencies. The integrated framework is shown to stabilize the solution and reduce error accumulation for both interpolation and extrapolation of the Korteweg-de Vries equation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/23/2019

Neural Integration of Continuous Dynamics

Neural dynamical systems are dynamical systems that are described at lea...
research
09/06/2020

Spatio-Temporal Activation Function To Map Complex Dynamical Systems

Most of the real world is governed by complex and chaotic dynamical syst...
research
11/11/2021

Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networks

Data assimilation techniques are widely used to predict complex dynamica...
research
05/25/2017

Predictive State Recurrent Neural Networks

We present a new model, Predictive State Recurrent Neural Networks (PSRN...
research
06/01/2022

Non-Intrusive Reduced Models based on Operator Inference for Chaotic Systems

This work explores the physics-driven machine learning technique Operato...
research
06/13/2018

The streaming rollout of deep networks - towards fully model-parallel execution

Deep neural networks, and in particular recurrent networks, are promisin...
research
05/28/2021

Accelerating Neural ODEs Using Model Order Reduction

Embedding nonlinear dynamical systems into artificial neural networks is...

Please sign up or login with your details

Forgot password? Click here to reset