Learning the parameters of a differential equation from its trajectory via the adjoint equation

06/17/2022
by   Imre Fekete, et al.
0

The paper contributes to strengthening the relation between machine learning and the theory of differential equations. In this context, the inverse problem of fitting the parameters, and the initial condition of a differential equation to some measurements constitutes a key issue. The paper explores an abstraction that can be used to construct a family of loss functions with the aim of fitting the solution of an initial value problem to a set of discrete or continuous measurements. It is shown, that an extension of the adjoint equation can be used to derive the gradient of the loss function as a continuous analogue of backpropagation in machine learning. Numerical evidence is presented that under reasonably controlled circumstances the gradients obtained this way can be used in a gradient descent to fit the solution of an initial value problem to a set of continuous noisy measurements, and a set of discrete noisy measurements that are recorded at uncertain times.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/29/2022

New Designed Loss Functions to Solve Ordinary Differential Equations with Artificial Neural Network

This paper investigates the use of artificial neural networks (ANNs) to ...
research
05/21/2021

Estimating Unknown Time-Varying Parameters in Uncertain Differential Equation

Uncertain differential equations have a wide range of applications. How ...
research
10/28/2022

Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis

We derive and solve an “Equation of Motion” (EoM) for deep neural networ...
research
02/11/2022

Learning via nonlinear conjugate gradients and depth-varying neural ODEs

The inverse problem of supervised reconstruction of depth-variable (time...
research
07/05/2017

Machine Learning, Deepest Learning: Statistical Data Assimilation Problems

We formulate a strong equivalence between machine learning, artificial i...
research
06/22/2017

Continuum Limit of Posteriors in Graph Bayesian Inverse Problems

We consider the problem of recovering a function input of a differential...
research
12/09/2022

A PINN Approach to Symbolic Differential Operator Discovery with Sparse Data

Given ample experimental data from a system governed by differential equ...

Please sign up or login with your details

Forgot password? Click here to reset