Embedding stochastic differential equations into neural networks via dual processes

06/08/2023
by   Naoki Sughishita, et al.
0

We propose a new approach to constructing a neural network for predicting expectations of stochastic differential equations. The proposed method does not need data sets of inputs and outputs; instead, the information obtained from the time-evolution equations, i.e., the corresponding dual process, is directly compared with the weights in the neural network. As a demonstration, we construct neural networks for the Ornstein-Uhlenbeck process and the noisy van der Pol system. The remarkable feature of learned networks with the proposed method is the accuracy of inputs near the origin. Hence, it would be possible to avoid the overfitting problem because the learned network does not depend on training data sets.

READ FULL TEXT
research
01/29/2020

The Gâteaux-Hopfield Neural Network method

In the present work a new set of differential equations for the Hopfield...
research
05/27/2020

Approximating periodic functions and solving differential equations using a novel type of Fourier Neural Networks

Recently, machine learning tools in particular neural networks have been...
research
03/27/2021

Deep Learning Schemes For Parabolic Nonlocal Integro-Differential Equations

In this paper we consider the numerical approximation of nonlocal integr...
research
05/19/2022

Neural ODEs with Irregular and Noisy Data

Measurement noise is an integral part while collecting data of a physica...
research
08/19/2018

Artificial Neural Networks in Fluid Dynamics: A Novel Approach to the Navier-Stokes Equations

Neural networks have been used to solve different types of large data re...
research
02/09/2021

On Theory-training Neural Networks to Infer the Solution of Highly Coupled Differential Equations

Deep neural networks are transforming fields ranging from computer visio...
research
04/11/2022

Neural Processes with Stochastic Attention: Paying more attention to the context dataset

Neural processes (NPs) aim to stochastically complete unseen data points...

Please sign up or login with your details

Forgot password? Click here to reset