Machine Learning for Prediction with Missing Dynamics

10/13/2019
by   John Harlim, et al.
0

This article presents a general framework for recovering missing dynamical systems using available data and machine learning techniques. The proposed framework reformulates the prediction problem as a supervised learning problem to approximate a map that takes the memories of the resolved and identifiable unresolved variables to the missing components in the resolved dynamics. We demonstrate the effectiveness of the proposed framework with a theoretical guarantee of a path-wise convergence of the resolved variables up to finite time and numerical tests on prototypical models in various scientific domains. These include the 57-mode barotropic stress models with multiscale interactions that mimic the blocked and unblocked patterns observed in the atmosphere, the nonlinear Schrödinger equation which found many applications in physics such as optics and Bose-Einstein-Condense, the Kuramoto-Sivashinsky equation which spatiotemporal chaotic pattern formation models trapped ion mode in plasma and phase dynamics in reaction-diffusion systems. While many machine learning techniques can be used to validate the proposed framework, we found that recurrent neural networks outperform kernel regression methods in terms of recovering the trajectory of the resolved components and the equilibrium one-point and two-point statistics. This superb performance suggests that recurrent neural networks are an effective tool for recovering the missing dynamics that involves approximation of high-dimensional functions.

READ FULL TEXT

page 1

page 20

page 21

page 22

page 26

page 27

page 28

page 29

research
09/11/2023

Interpretable learning of effective dynamics for multiscale systems

The modeling and simulation of high-dimensional multiscale systems is a ...
research
07/27/2019

Time-series machine-learning error models for approximate solutions to parameterized dynamical systems

This work proposes a machine-learning framework for modeling the error i...
research
02/02/2021

Effective Mori-Zwanzig equation for the reduced-order modeling of stochastic systems

Built upon the hypoelliptic analysis of the effective Mori-Zwanzig (EMZ)...
research
11/04/2021

Identifying nonlinear dynamical systems from multi-modal time series data

Empirically observed time series in physics, biology, or medicine, are c...
research
05/17/2019

Modeling of Missing Dynamical Systems: Deriving Parametric Models using a Nonparametric Framework

In this paper, we consider modeling missing dynamics with a non-Markovia...
research
02/10/2022

Computer Validation of Neural Network Dynamics: A First Case Study

A large number of current machine learning methods rely upon deep neural...
research
05/26/2023

A Multi-Resolution Physics-Informed Recurrent Neural Network: Formulation and Application to Musculoskeletal Systems

This work presents a multi-resolution physics-informed recurrent neural ...

Please sign up or login with your details

Forgot password? Click here to reset