Learning Sampling Dictionaries for Efficient and Generalizable Robot Motion Planning with Transformers

06/01/2023
by   Jacob J. Johnson, et al.
0

Motion planning is integral to robotics applications such as autonomous driving, surgical robots, and industrial manipulators. Existing planning methods lack scalability to higher-dimensional spaces, while recent learning based planners have shown promise in accelerating sampling-based motion planners (SMP) but lack generalizability to out-of-distribution environments. To address this, we present a novel approach, Vector Quantized-Motion Planning Transformers (VQ-MPT) that overcomes the key generalization and scaling drawbacks of previous learning-based methods. VQ-MPT consists of two stages. Stage 1 is a Vector Quantized-Variational AutoEncoder model that learns to represent the planning space using a finite number of sampling distributions, and stage 2 is an Auto-Regressive model that constructs a sampling region for SMPs by selecting from the learned sampling distribution sets. By splitting large planning spaces into discrete sets and selectively choosing the sampling regions, our planner pairs well with out-of-the-box SMPs, generating near-optimal paths faster than without VQ-MPT's aid. It is generalizable in that it can be applied to systems of varying complexities, from 2D planar to 14D bi-manual robots with diverse environment representations, including costmaps and point clouds. Trained VQ-MPT models generalize to environments unseen during training and achieve higher success rates than previous methods.

READ FULL TEXT

page 1

page 5

page 6

research
01/27/2023

Bi-AM-RRT*: A Fast and Efficient Sampling-Based Motion Planning Algorithm in Dynamic Environments

The efficiency of sampling-based motion planning brings wide application...
research
07/13/2019

Motion Planning Networks: Bridging the Gap Between Learning-based and Classical Motion Planners

This paper describes Motion Planning Networks (MPNet), a computationally...
research
09/30/2019

Dispertio: Optimal Sampling for Safe Deterministic Sampling-Based Motion Planning

A key challenge in robotics is the efficient generation of optimal robot...
research
10/21/2020

Learning to Plan Optimally with Flow-based Motion Planner

Sampling-based motion planning is the predominant paradigm in many real-...
research
03/12/2023

Non-Trivial Query Sampling For Efficient Learning To Plan

In recent years, learning-based approaches have revolutionized motion pl...
research
04/21/2021

Custom Distribution for Sampling-Based Motion Planning

Sampling-based algorithms are widely used in robotics because they are v...
research
11/17/2020

Near-Optimal Multi-Robot Motion Planning with Finite Sampling

An underlying structure in several sampling-based methods for continuous...

Please sign up or login with your details

Forgot password? Click here to reset