Experiments with Tractable Feedback in Robotic Planning under Uncertainty: Insights over a wide range of noise regimes

We consider the problem of robotic planning under uncertainty. This problem may be posed as a stochastic optimal control problem, complete solution to which is fundamentally intractable owing to the infamous curse of dimensionality. We report the results of an extensive simulation study in which we have compared two methods, both of which aim to salvage tractability by using alternative, albeit inexact, means for treating feedback. The first is a recently proposed method based on a near-optimal "decoupling principle" for tractable feedback design, wherein a nominal open-loop problem is solved, followed by a linear feedback design around the open-loop. The second is Model Predictive Control (MPC), a widely-employed method that uses repeated re-computation of the nominal open-loop problem during execution to correct for noise, though when interpreted as feedback, this can only said to be an implicit form. We examine a much wider range of noise levels than have been previously reported and empirical evidence suggests that the decoupling method allows for tractable planning over a wide range of uncertainty conditions without unduly sacrificing performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/01/2020

Near Optimality and Tractability in Stochastic Nonlinear Control

We consider the problem of nonlinear stochastic optimal control. This is...
research
02/21/2020

On the Search for Feedback in Reinforcement Learning

This paper addresses the problem of learning the optimal feedback policy...
research
07/16/2021

Partially-Observed Decoupled Data-based Control (POD2C) for Complex Robotic Systems

This paper develops a systematic data-based approach to the closed-loop ...
research
08/19/2021

Neural Predictive Control for the Optimization of Smart Grid Flexibility Schedules

Model predictive control (MPC) is a method to formulate the optimal sche...
research
06/08/2016

Feedback Scheduling for Energy-Efficient Real-Time Homogeneous Multiprocessor Systems

Real-time scheduling algorithms proposed in the literature are often bas...
research
03/22/2018

Robotic Sewing and Knot Tying for Personalized Stent Graft Manufacturing

This paper presents a versatile robotic system for sewing 3D structured ...
research
10/02/2022

An optimal open-loop strategy for handling a flexible beam with a robot manipulator

Fast and safe manipulation of flexible objects with a robot manipulator ...

Please sign up or login with your details

Forgot password? Click here to reset