Stationary Density Estimation of Itô Diffusions Using Deep Learning

09/09/2021
by   Yiqi Gu, et al.
0

In this paper, we consider the density estimation problem associated with the stationary measure of ergodic Itô diffusions from a discrete-time series that approximate the solutions of the stochastic differential equations. To take an advantage of the characterization of density function through the stationary solution of a parabolic-type Fokker-Planck PDE, we proceed as follows. First, we employ deep neural networks to approximate the drift and diffusion terms of the SDE by solving appropriate supervised learning tasks. Subsequently, we solve a steady-state Fokker-Plank equation associated with the estimated drift and diffusion coefficients with a neural-network-based least-squares method. We establish the convergence of the proposed scheme under appropriate mathematical assumptions, accounting for the generalization errors induced by regressing the drift and diffusion coefficients, and the PDE solvers. This theoretical study relies on a recent perturbation theory of Markov chain result that shows a linear dependence of the density estimation to the error in estimating the drift term, and generalization error results of nonparametric regression and of PDE regression solution obtained with neural-network models. The effectiveness of this method is reflected by numerical simulations of a two-dimensional Student's t distribution and a 20-dimensional Langevin dynamics.

READ FULL TEXT

page 14

page 15

research
12/26/2021

Drift estimation for a multi-dimensional diffusion process using deep neural networks

Recently, many studies have shed light on the high adaptivity of deep ne...
research
02/05/2023

Nonparametric Density Estimation under Distribution Drift

We study nonparametric density estimation in non-stationary drift settin...
research
05/21/2021

Error Bounds of the Invariant Statistics in Machine Learning of Ergodic Itô Diffusions

This paper studies the theoretical underpinnings of machine learning of ...
research
03/28/2021

Variational inference of the drift function for stochastic differential equations driven by Lévy processes

In this paper, we consider the nonparametric estimation problem of the d...
research
04/14/2021

Deep Data Density Estimation through Donsker-Varadhan Representation

Estimating the data density is one of the challenging problems in deep l...
research
09/23/2019

PDE-Inspired Algorithms for Semi-Supervised Learning on Point Clouds

Given a data set and a subset of labels the problem of semi-supervised l...

Please sign up or login with your details

Forgot password? Click here to reset