A Direct Method to Learn States and Parameters of Ordinary Differential Equations

10/16/2018
by   Ramin Raziperchikolaei, et al.
0

Though ordinary differential equations (ODE) are used extensively in science and engineering, the task of learning ODE parameters from noisy observations still presents challenges. To address these challenges, we propose a direct method that involves alternating minimization of an objective function over the filtered states and parameters. This objective function directly measures how well the filtered states and parameters satisfy the ODE, in contrast to many existing methods that use separate objectives over the observations, filtered states, and parameters. As we show on several ODE systems, as compared to state-of-the-art methods, the direct method exhibits increased robustness (to noise, parameter initialization, and hyperparameters), decreased training times, and improved accuracy in estimating both filtered states and parameters. The direct method involves only one hyperparameter that plays the role of an inverse step size. We show how the direct method can be used with general multistep numerical discretizations, and demonstrate its performance on systems with up to d=40 dimensions. The code of our algorithms can be found in the authors' web pages.

READ FULL TEXT

page 12

page 13

page 14

research
04/04/2023

A Bayesian Collocation Integral Method for Parameter Estimation in Ordinary Differential Equations

Inferring the parameters of ordinary differential equations (ODEs) from ...
research
08/18/2022

A Joint Estimation Approach to Sparse Additive Ordinary Differential Equations

Ordinary differential equations (ODEs) are widely used to characterize t...
research
06/08/2023

Data-Adaptive Probabilistic Likelihood Approximation for Ordinary Differential Equations

Parameter inference for ordinary differential equations (ODEs) is of fun...
research
06/20/2017

Statistical Mechanics of Node-perturbation Learning with Noisy Baseline

Node-perturbation learning is a type of statistical gradient descent alg...
research
07/24/2023

Predicting Ordinary Differential Equations with Transformers

We develop a transformer-based sequence-to-sequence model that recovers ...
research
09/01/2021

Solving the Discrete Euler-Arnold Equations for the Generalized Rigid Body Motion

We propose three iterative methods for solving the Moser-Veselov equatio...
research
04/27/2023

Hyperparameter optimization of orthogonal functions in the numerical solution of differential equations

This paper considers the hyperparameter optimization problem of mathemat...

Please sign up or login with your details

Forgot password? Click here to reset