Regularity and time discretization of extended mean field control problems: a McKean-Vlasov FBSDE approach

09/17/2020
by   Christoph Reisinger, et al.
0

We analyze the solution regularity and discrete-time approximations of extended mean field control (extended MFC) problems, which seek optimal control of McKean-Vlasov dynamics whose coefficients involve mean field interactions both on the state and actions, and where objectives are optimized over open-loop strategies. We show that for a large class of extended MFC problems, the unique optimal open-loop control is 1/2-Hölder continuous in time. Based on the solution regularity, we prove that the value functions of such extended MFC problems can be approximated by those with piecewise constant controls and discrete-time state processes arising from Euler-Maruyama time stepping up to an order 1/2 error, which is optimal in our setting. We further show that any ϵ-optimal controls of these discrete-time problems converge to the optimal control of the original problems. To establish the time regularity of optimal controls and the convergence of time discretizations, we extend the canonical path regularity results to general coupled McKean-Vlasov forward-backward stochastic differential equations, which are of independent interest.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2020

Optimal control and stablilization for linear continuous-time mean-field systems with delay

This paper studies optimal control and stabilization problems for contin...
research
03/26/2021

On the Time Discretization of the Feynman-Kac Forward-Backward Stochastic Differential Equations for Value Function Approximation

Novel numerical estimators are proposed for the forward-backward stochas...
research
10/27/2020

Hamilton-Jacobi Deep Q-Learning for Deterministic Continuous-Time Systems with Lipschitz Continuous Controls

In this paper, we propose Q-learning algorithms for continuous-time dete...
research
01/18/2022

Convergence of a robust deep FBSDE method for stochastic control

In this paper we propose a deep learning based numerical scheme for stro...
research
12/17/2017

Computing Optimal Control of Cascading Failure in DC Networks

We consider discrete-time dynamics, for cascading failure in DC networks...
research
06/25/2023

A Neural RDE approach for continuous-time non-Markovian stochastic control problems

We propose a novel framework for solving continuous-time non-Markovian s...

Please sign up or login with your details

Forgot password? Click here to reset