Recent Developments in Machine Learning Methods for Stochastic Control and Games

03/17/2023
by   Ruimeng Hu, et al.
0

Stochastic optimal control and games have found a wide range of applications, from finance and economics to social sciences, robotics and energy management. Many real-world applications involve complex models which have driven the development of sophisticated numerical methods. Recently, computational methods based on machine learning have been developed for stochastic control problems and games. We review such methods, with a focus on deep learning algorithms that have unlocked the possibility to solve such problems even when the dimension is high or when the structure is very complex, beyond what is feasible with traditional numerical methods. Here, we consider mostly the continuous time and continuous space setting. Many of the new approaches build on recent neural-network based methods for high-dimensional partial differential equations or backward stochastic differential equations, or on model-free reinforcement learning for Markov decision processes that have led to breakthrough results. In this paper we provide an introduction to these methods and summarize state-of-the-art works on machine learning for stochastic control and games.

READ FULL TEXT
research
10/21/2021

Deep Reinforcement Learning for Online Control of Stochastic Partial Differential Equations

In many areas, such as the physical sciences, life sciences, and finance...
research
11/27/2019

Introduction to Solving Quant Finance Problems with Time-Stepped FBSDE and Deep Learning

In this introductory paper, we discuss how quantitative finance problems...
research
02/11/2019

Neural Network Architectures for Stochastic Control using the Nonlinear Feynman-Kac Lemma

In this paper we propose a new methodology for decision-making under unc...
research
04/12/2022

A deep learning method for solving stochastic optimal control problems driven by fully-coupled FBSDEs

In this paper, we mainly focus on the numerical solution of high-dimensi...
research
02/22/2022

Myriad: a real-world testbed to bridge trajectory optimization and deep learning

We present Myriad, a testbed written in JAX for learning and planning in...
research
06/10/2020

Machine Learning and Control Theory

We survey in this article the connections between Machine Learning and C...
research
06/02/2022

Bayesian Inference of Stochastic Dynamical Networks

Network inference has been extensively studied in several fields, such a...

Please sign up or login with your details

Forgot password? Click here to reset