A Tensor Decomposition Approach for High-Dimensional Hamilton-Jacobi-Bellman Equations

by   Sergey Dolgov, et al.

A tensor decomposition approach for the solution of high-dimensional, fully nonlinear Hamilton-Jacobi-Bellman equations arising in optimal feedback control and estimation of nonlinear dynamics is presented. The proposed method combines a tensor train approximation for the value function together with a Newton-like iterative method for the solution of the resulting nonlinear system. The effectiveness of tensor approximations circumvents the curse of dimensionality, solving Hamilton-Jacobi equations with more than 100 dimensions at modest cost. The linear scaling of the computational complexity with respect to the dimension allows to solve PDE-constrained optimal feedback control problems over high-dimensional state spaces. Numerical tests including the control of a 2D nonlinear reaction equation and the stabilization of a bilinear Fokker-Planck equation are presented.


Solving high-dimensional nonlinear filtering problems using a tensor train decomposition method

In this paper, we propose an efficient numerical method to solve high-di...

State-dependent Riccati equation feedback stabilization for nonlinear PDEs

The synthesis of suboptimal feedback laws for controlling nonlinear dyna...

Committor functions via tensor networks

We propose a novel approach for computing committor functions, which des...

Gradient-augmented Supervised Learning of Optimal Feedback Laws Using State-dependent Riccati Equations

A supervised learning approach for the solution of large-scale nonlinear...

Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats

Controlling systems of ordinary differential equations (ODEs) is ubiquit...

QRnet: optimal regulator design with LQR-augmented neural networks

In this paper we propose a new computational method for designing optima...

On the Adimensional Scale Invariant Steffensen (ASIS) Method

Dimensionality of parameters and variables is a fundamental issue in phy...