Deep Forward-Backward SDEs for Min-max Control

06/11/2019
by   Ziyi Wang, et al.
0

This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic partial differential equations and forward-backward stochastic differential equations. Using this theorem the Hamilton-Jacobi-Isaacs partial differential equation associated with differential games is represented by a system of forward-backward stochastic differential equations. Numerical solution of the aforementioned system of stochastic differential equations is performed using importance sampling and a Long-Short Term Memory recurrent neural network, which is trained in an offline fashion. The resulting algorithm is tested on two example systems in simulation and compared against the standard risk neutral stochastic optimal control formulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/11/2019

Neural Network Architectures for Stochastic Control using the Nonlinear Feynman-Kac Lemma

In this paper we propose a new methodology for decision-making under unc...
research
04/05/2022

Deep Graphic FBSDEs for Opinion Dynamics Stochastic Control

In this paper, we present a scalable deep learning approach to solve opi...
research
06/11/2019

Deep 2FBSDEs for Systems with Control Multiplicative Noise

We present a deep recurrent neural network architecture to solve a class...
research
04/25/2023

On forward-backward SDE approaches to continuous-time minimum variance estimation

The work of Kalman and Bucy has established a duality between filtering ...
research
03/04/2020

PDGM: a Neural Network Approach to Solve Path-Dependent Partial Differential Equations

In this paper we propose a generalization of the Deep Galerking Method (...
research
11/30/2019

Applications of the Deep Galerkin Method to Solving Partial Integro-Differential and Hamilton-Jacobi-Bellman Equations

We extend the Deep Galerkin Method (DGM) introduced in Sirignano and Spi...
research
11/27/2019

Introduction to Solving Quant Finance Problems with Time-Stepped FBSDE and Deep Learning

In this introductory paper, we discuss how quantitative finance problems...

Please sign up or login with your details

Forgot password? Click here to reset