Near Optimality and Tractability in Stochastic Nonlinear Control

We consider the problem of nonlinear stochastic optimal control. This is fundamentally intractable owing to Bellman's infamous "curse of dimensionality". We present a "decoupling principle" for the tractable feedback design for such problems, wherein, first, a nominal open-loop problem is solved, followed by a suitable linear feedback design around the open-loop. The performance of the resulting feedback law is shown to be asymptotically close to the true stochastic feedback law to fourth order in a small noise parameter ϵ. The decoupling theory is empirically tested on robotic planning problems under uncertainty.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2020

Experiments with Tractable Feedback in Robotic Planning under Uncertainty: Insights over a wide range of noise regimes

We consider the problem of robotic planning under uncertainty. This prob...
research
07/16/2021

Partially-Observed Decoupled Data-based Control (POD2C) for Complex Robotic Systems

This paper develops a systematic data-based approach to the closed-loop ...
research
02/21/2020

On the Search for Feedback in Reinforcement Learning

This paper addresses the problem of learning the optimal feedback policy...
research
06/29/2017

Runaway Feedback Loops in Predictive Policing

Predictive policing systems are increasingly used to determine how to al...
research
03/27/2021

On the Stability of Nonlinear Receding Horizon Control: A Geometric Perspective

The widespread adoption of nonlinear Receding Horizon Control (RHC) stra...
research
06/02/2021

Concurrent Learning Based Tracking Control of Nonlinear Systems using Gaussian Process

This paper demonstrates the applicability of the combination of concurre...

Please sign up or login with your details

Forgot password? Click here to reset