Accelerating Simulation of Stiff Nonlinear Systems using Continuous-Time Echo State Networks

10/07/2020
by   Ranjan Anantharaman, et al.
0

Modern design, control, and optimization often requires simulation of highly nonlinear models, leading to prohibitive computational costs. These costs can be amortized by evaluating a cheap surrogate of the full model. Here we present a general data-driven method, the continuous-time echo state network (CTESN), for generating surrogates of nonlinear ordinary differential equations with dynamics at widely separated timescales. We empirically demonstrate near-constant time performance using our CTESNs on a physically motivated scalable model of a heating system whose full execution time increases exponentially, while maintaining relative error of within 0.2 that our model captures fast transients as well as slow dynamics effectively, while other techniques such as physics informed neural networks have difficulties trying to train and predict the highly nonlinear behavior of these models.

READ FULL TEXT
research
11/28/2017

Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations

We introduce physics informed neural networks -- neural networks that ar...
research
10/20/2022

Neural ODEs as Feedback Policies for Nonlinear Optimal Control

Neural ordinary differential equations (Neural ODEs) model continuous ti...
research
05/12/2021

Composing Modeling and Simulation with Machine Learning in Julia

In this paper we introduce JuliaSim, a high-performance programming envi...
research
11/01/2022

Transfer Learning with Physics-Informed Neural Networks for Efficient Simulation of Branched Flows

Physics-Informed Neural Networks (PINNs) offer a promising approach to s...
research
04/06/2023

Unconstrained Parametrization of Dissipative and Contracting Neural Ordinary Differential Equations

In this work, we introduce and study a class of Deep Neural Networks (DN...
research
01/09/2020

Learning ergodic averages in chaotic systems

We propose a physics-informed machine learning method to predict the tim...
research
01/16/2022

Solving Inventory Management Problems with Inventory-dynamics-informed Neural Networks

A key challenge in inventory management is to identify policies that opt...

Please sign up or login with your details

Forgot password? Click here to reset