Bayesian Spline Learning for Equation Discovery of Nonlinear Dynamics with Quantified Uncertainty

10/14/2022
by   Luning Sun, et al.
0

Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us understand and predict the behavior of complex dynamic systems. Although extensive work has recently been done in this field, robustly distilling explicit model forms from very sparse data with considerable noise remains intractable. Moreover, quantifying and propagating the uncertainty of the identified system from noisy data is challenging, and relevant literature is still limited. To bridge this gap, we develop a novel Bayesian spline learning framework to identify parsimonious governing equations of nonlinear (spatio)temporal dynamics from sparse, noisy data with quantified uncertainty. The proposed method utilizes spline basis to handle the data scarcity and measurement noise, upon which a group of derivatives can be accurately computed to form a library of candidate model terms. The equation residuals are used to inform the spline learning in a Bayesian manner, where approximate Bayesian uncertainty calibration techniques are employed to approximate posterior distributions of the trainable parameters. To promote the sparsity, an iterative sequential-threshold Bayesian learning approach is developed, using the alternative direction optimization strategy to systematically approximate L0 sparsity constraints. The proposed algorithm is evaluated on multiple nonlinear dynamical systems governed by canonical ordinary and partial differential equations, and the merit/superiority of the proposed method is demonstrated by comparison with state-of-the-art methods.

READ FULL TEXT

page 8

page 19

page 20

research
04/15/2020

Bayesian differential programming for robust systems identification under uncertainty

This paper presents a machine learning framework for Bayesian systems id...
research
09/06/2022

A Bayesian Approach for Spatio-Temporal Data-Driven Dynamic Equation Discovery

Differential equations based on physical principals are used to represen...
research
06/01/2022

Learning Sparse Nonlinear Dynamics via Mixed-Integer Optimization

Discovering governing equations of complex dynamical systems directly fr...
research
04/22/2022

Sparse dynamical system identification with simultaneous structural parameters and initial condition estimation

Sparse Identification of Nonlinear Dynamics (SINDy) has been shown to su...
research
11/22/2021

Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control

Sparse model identification enables the discovery of nonlinear dynamical...
research
11/19/2022

Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constants

Recent progress in autoencoder-based sparse identification of nonlinear ...
research
09/18/2019

Learning Discrepancy Models From Experimental Data

First principles modeling of physical systems has led to significant tec...

Please sign up or login with your details

Forgot password? Click here to reset