HJB-RBF based approach for the control of PDEs

08/06/2021
by   Alessandro Alla, et al.
0

Semi-lagrangian schemes for discretization of the dynamic programming principle are based on a time discretization projected on a state-space grid. The use of a structured grid makes this approach not feasible for high-dimensional problems due to the curse of dimensionality. Here, we present a new approach for infinite horizon optimal control problems where the value function is computed using Radial Basis Functions (RBF) by the Shepard's moving least squares approximation method on scattered grids. We propose a new method to generate a scattered mesh driven by the dynamics and the selection of the shape parameter in the RBF using an optimization routine. This mesh will help to localize the problem and approximate the dynamic programming principle in high dimension. Error estimates for the value function are also provided. Numerical tests for high dimensional problems will show the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/15/2022

Approximation of Optimal Control Problems for the Navier-Stokes equation via multilinear HJB-POD

We consider the approximation of some optimal control problems for the N...
research
01/10/2013

A Tractable POMDP for a Class of Sequencing Problems

We consider a partially observable Markov decision problem (POMDP) that ...
research
12/26/2013

Shape-constrained Estimation of Value Functions

We present a fully nonparametric method to estimate the value function, ...
research
11/08/2019

On approximating the shape of one dimensional functions

Consider an s-dimensional function being evaluated at n points of a low ...
research
09/25/2020

A tree structure algorithm for optimal control problems with state constraints

We present a tree structure algorithm for optimal control problems with ...
research
10/05/2022

Feedback reconstruction techniques for optimal control problems on a tree structure

The computation of feedback control using Dynamic Programming equation i...
research
07/10/2014

A New Optimal Stepsize For Approximate Dynamic Programming

Approximate dynamic programming (ADP) has proven itself in a wide range ...

Please sign up or login with your details

Forgot password? Click here to reset