Policy iteration for the deterministic control problems – a viscosity approach

01/01/2023
by   Wenpin Tang, et al.
0

This paper is concerned with the convergence rate of policy iteration for (deterministic) optimal control problems in continuous time. To overcome the problem of ill-posedness due to lack of regularity, we consider a semi-discrete scheme by adding a viscosity term via finite differences in space. We prove that PI for the semi-discrete scheme converges exponentially fast, and provide a bound on the error induced by the semi-discrete scheme. We also consider the discrete space-time scheme, where both space and time are discretized. Convergence rate of PI and the discretization error are studied.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/24/2020

Optimal error estimate for a space-time discretization for incompressible generalized Newtonian fluids: The Dirichlet problem

In this paper we prove optimal error estimates for solutions with natura...
research
02/11/2023

A Policy Gradient Framework for Stochastic Optimal Control Problems with Global Convergence Guarantee

In this work, we consider the stochastic optimal control problem in cont...
research
05/01/2021

High-accuracy time discretization of stochastic fractional diffusion equation

A high-accuracy time discretization is discussed to numerically solve th...
research
09/19/2022

Strong convergence of parabolic rate 1 of discretisations of stochastic Allen-Cahn-type equations

Consider the approximation of stochastic Allen-Cahn-type equations (i.e....
research
03/22/2022

Exponential Convergence of hp-Time-Stepping in Space-Time Discretizations of Parabolic PDEs

For linear parabolic initial-boundary value problems with self-adjoint, ...
research
12/28/2022

Analysis of a Peaceman-Rachford ADI scheme for Maxwell equations in heterogeneous media

The Peaceman-Rachford alternating direction implicit (ADI) scheme for li...
research
02/04/2022

An exponentially convergent discretization for space-time fractional parabolic equations using hp-FEM

We consider a space-time fractional parabolic problem. Combining a sinc-...

Please sign up or login with your details

Forgot password? Click here to reset