Bayesian polynomial neural networks and polynomial neural ordinary differential equations

08/17/2023
by   Colby Fronk, et al.
0

Symbolic regression with polynomial neural networks and polynomial neural ordinary differential equations (ODEs) are two recent and powerful approaches for equation recovery of many science and engineering problems. However, these methods provide point estimates for the model parameters and are currently unable to accommodate noisy data. We address this challenge by developing and validating the following Bayesian inference methods: the Laplace approximation, Markov Chain Monte Carlo (MCMC) sampling methods, and variational inference. We have found the Laplace approximation to be the best method for this class of problems. Our work can be easily extended to the broader class of symbolic neural networks to which the polynomial neural network belongs.

READ FULL TEXT

page 9

page 12

page 13

page 16

page 19

page 20

page 21

research
08/09/2022

Interpretable Polynomial Neural Ordinary Differential Equations

Neural networks have the ability to serve as universal function approxim...
research
06/10/2022

Neural Laplace: Learning diverse classes of differential equations in the Laplace domain

Neural Ordinary Differential Equations model dynamical systems with ODEs...
research
02/13/2022

Faster Gröbner Bases via Domain-Specific Ordering in Parameter Identifiability of ODE Models

We consider a specific class of polynomial systems that arise in paramet...
research
05/18/2022

An importance sampling approach for reliable and efficient inference in Bayesian ordinary differential equation models

Statistical models can involve implicitly defined quantities, such as so...
research
05/08/2020

Optimal Thinning of MCMC Output

The use of heuristics to assess the convergence and compress the output ...
research
12/08/2020

Accelerating Continuous Normalizing Flow with Trajectory Polynomial Regularization

In this paper, we propose an approach to effectively accelerating the co...
research
05/25/2019

Application and Computation of Probabilistic Neural Plasticity

The discovery of neural plasticity has proved that throughout the life o...

Please sign up or login with your details

Forgot password? Click here to reset