Robust SDE-Based Variational Formulations for Solving Linear PDEs via Deep Learning

06/21/2022
by   Lorenz Richter, et al.
0

The combination of Monte Carlo methods and deep learning has recently led to efficient algorithms for solving partial differential equations (PDEs) in high dimensions. Related learning problems are often stated as variational formulations based on associated stochastic differential equations (SDEs), which allow the minimization of corresponding losses using gradient-based optimization methods. In respective numerical implementations it is therefore crucial to rely on adequate gradient estimators that exhibit low variance in order to reach convergence accurately and swiftly. In this article, we rigorously investigate corresponding numerical aspects that appear in the context of linear Kolmogorov PDEs. In particular, we systematically compare existing deep learning approaches and provide theoretical explanations for their performances. Subsequently, we suggest novel methods that can be shown to be more robust both theoretically and numerically, leading to substantial performance improvements.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/31/2020

Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learning

In recent years, tremendous progress has been made on numerical algorith...
research
12/22/2020

An overview on deep learning-based approximation methods for partial differential equations

It is one of the most challenging problems in applied mathematics to app...
research
07/28/2023

From continuous-time formulations to discretization schemes: tensor trains and robust regression for BSDEs and parabolic PDEs

The numerical approximation of partial differential equations (PDEs) pos...
research
10/28/2022

Convergence analysis of a quasi-Monte Carlo-based deep learning algorithm for solving partial differential equations

Deep learning methods have achieved great success in solving partial dif...
research
09/30/2017

The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problems

We propose a deep learning based method, the Deep Ritz Method, for numer...
research
05/10/2022

Deep Learning-based Schemes for Singularly Perturbed Convection-Diffusion Problems

Deep learning-based numerical schemes such as Physically Informed Neural...
research
03/16/2023

Enabling First-Order Gradient-Based Learning for Equilibrium Computation in Markets

Understanding and analyzing markets is crucial, yet analytical equilibri...

Please sign up or login with your details

Forgot password? Click here to reset