Sampling Complexity of Path Integral Methods for Trajectory Optimization

03/18/2022
by   Hyung-Jin Yoon, et al.
0

The use of random sampling in decision-making and control has become popular with the ease of access to graphic processing units that can generate and calculate multiple random trajectories for real-time robotic applications. In contrast to sequential optimization, the sampling-based method can take advantage of parallel computing to maintain constant control loop frequencies. Inspired by its wide applicability in robotic applications, we calculate a sampling complexity result applicable to general nonlinear systems considered in the path integral method, which is a sampling-based method. The result determines the required number of samples to satisfy the given error bounds of the estimated control signal from the optimal value with the predefined risk probability. The sampling complexity result shows that the variance of the estimated control value is upper-bounded in terms of the expectation of the cost. Then we apply the result to a linear time-varying dynamical system with quadratic cost and an indicator function cost to avoid constraint sets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2022

Risk-Aware Model Predictive Path Integral Control Using Conditional Value-at-Risk

In this paper, we present a novel Model Predictive Control method for au...
research
04/06/2020

Control of Unknown Nonlinear Systems with Linear Time-Varying MPC

We present a Model Predictive Control (MPC) strategy for unknown input-a...
research
03/26/2019

Efficient Trajectory Generation for Robotic Systems Constrained by Contact Forces

In this work, we propose a trajectory generation method for robotic syst...
research
10/16/2020

Direct Policy Optimization using Deterministic Sampling and Collocation

We present an approach for approximately solving discrete-time stochasti...
research
01/30/2023

RRT Guided Model Predictive Path Integral Method

This work presents an optimal sampling-based method to solve the real-ti...
research
05/25/2023

Computing the Quadratic Numerical Range

A novel algorithm for the computation of the quadratic numerical range i...
research
09/19/2023

Guarantees on Robot System Performance Using Stochastic Simulation Rollouts

We provide finite-sample performance guarantees for control policies exe...

Please sign up or login with your details

Forgot password? Click here to reset