Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models

08/03/2023
by   João Carvalho, et al.
0

Learning priors on trajectory distributions can help accelerate robot motion planning optimization. Given previously successful plans, learning trajectory generative models as priors for a new planning problem is highly desirable. Prior works propose several ways on utilizing this prior to bootstrapping the motion planning problem. Either sampling the prior for initializations or using the prior distribution in a maximum-a-posterior formulation for trajectory optimization. In this work, we propose learning diffusion models as priors. We then can sample directly from the posterior trajectory distribution conditioned on task goals, by leveraging the inverse denoising process of diffusion models. Furthermore, diffusion has been recently shown to effectively encode data multimodality in high-dimensional settings, which is particularly well-suited for large trajectory dataset. To demonstrate our method efficacy, we compare our proposed method - Motion Planning Diffusion - against several baselines in simulated planar robot and 7-dof robot arm manipulator environments. To assess the generalization capabilities of our method, we test it in environments with previously unseen obstacles. Our experiments show that diffusion models are strong priors to encode high-dimensional trajectory distributions of robot motions.

READ FULL TEXT

page 1

page 6

page 7

research
06/19/2018

Motion planning in high-dimensional spaces

Motion planning is a key tool that allows robots to navigate through an ...
research
11/13/2020

Joint Sampling and Trajectory Optimization over Graphs for Online Motion Planning

Among the most prevailing motion planning techniques, sampling and traje...
research
01/15/2023

Diffusion-based Generation, Optimization, and Planning in 3D Scenes

We introduce SceneDiffuser, a conditional generative model for 3D scene ...
research
11/22/2017

High-dimensional Motion Planning using Latent Variable Models via Approximate Inference

In this work, we present an efficient framework to generate a motion tra...
research
04/11/2022

Learning Implicit Priors for Motion Optimization

In this paper, we focus on the problem of integrating Energy-based Model...
research
06/15/2023

R2-Diff: Denoising by diffusion as a refinement of retrieved motion for image-based motion prediction

Image-based motion prediction is one of the essential techniques for rob...
research
08/12/2021

Put the Bear on the Chair! Intelligent Robot Interaction with Previously Unseen Objects via Robot Imagination

In this letter, we study the problem of autonomously placing a teddy bea...

Please sign up or login with your details

Forgot password? Click here to reset