A Tensor Decomposition Approach for High-Dimensional Hamilton-Jacobi-Bellman Equations

08/05/2019
by   Sergey Dolgov, et al.
0

A tensor decomposition approach for the solution of high-dimensional, fully nonlinear Hamilton-Jacobi-Bellman equations arising in optimal feedback control and estimation of nonlinear dynamics is presented. The proposed method combines a tensor train approximation for the value function together with a Newton-like iterative method for the solution of the resulting nonlinear system. The effectiveness of tensor approximations circumvents the curse of dimensionality, solving Hamilton-Jacobi equations with more than 100 dimensions at modest cost. The linear scaling of the computational complexity with respect to the dimension allows to solve PDE-constrained optimal feedback control problems over high-dimensional state spaces. Numerical tests including the control of a 2D nonlinear reaction equation and the stabilization of a bilinear Fokker-Planck equation are presented.

READ FULL TEXT
08/12/2019

Solving high-dimensional nonlinear filtering problems using a tensor train decomposition method

In this paper, we propose an efficient numerical method to solve high-di...
06/14/2021

State-dependent Riccati equation feedback stabilization for nonlinear PDEs

The synthesis of suboptimal feedback laws for controlling nonlinear dyna...
06/23/2021

Committor functions via tensor networks

We propose a novel approach for computing committor functions, which des...
03/06/2021

Gradient-augmented Supervised Learning of Optimal Feedback Laws Using State-dependent Riccati Equations

A supervised learning approach for the solution of large-scale nonlinear...
04/13/2021

Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats

Controlling systems of ordinary differential equations (ODEs) is ubiquit...
09/11/2020

QRnet: optimal regulator design with LQR-augmented neural networks

In this paper we propose a new computational method for designing optima...
06/14/2021

On the Adimensional Scale Invariant Steffensen (ASIS) Method

Dimensionality of parameters and variables is a fundamental issue in phy...