Deep Forward-Backward SDEs for Min-max Control

by   Ziyi Wang, et al.
Georgia Institute of Technology

This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic partial differential equations and forward-backward stochastic differential equations. Using this theorem the Hamilton-Jacobi-Isaacs partial differential equation associated with differential games is represented by a system of forward-backward stochastic differential equations. Numerical solution of the aforementioned system of stochastic differential equations is performed using importance sampling and a Long-Short Term Memory recurrent neural network, which is trained in an offline fashion. The resulting algorithm is tested on two example systems in simulation and compared against the standard risk neutral stochastic optimal control formulations.


page 1

page 2

page 3

page 4


Neural Network Architectures for Stochastic Control using the Nonlinear Feynman-Kac Lemma

In this paper we propose a new methodology for decision-making under unc...

Deep Graphic FBSDEs for Opinion Dynamics Stochastic Control

In this paper, we present a scalable deep learning approach to solve opi...

Deep 2FBSDEs for Systems with Control Multiplicative Noise

We present a deep recurrent neural network architecture to solve a class...

On forward-backward SDE approaches to continuous-time minimum variance estimation

The work of Kalman and Bucy has established a duality between filtering ...

PDGM: a Neural Network Approach to Solve Path-Dependent Partial Differential Equations

In this paper we propose a generalization of the Deep Galerking Method (...

Introduction to Solving Quant Finance Problems with Time-Stepped FBSDE and Deep Learning

In this introductory paper, we discuss how quantitative finance problems...

Please sign up or login with your details

Forgot password? Click here to reset