Visually Grounded Task and Motion Planning for Mobile Manipulation

02/22/2022
by   Xiaohan Zhang, et al.
0

Task and motion planning (TAMP) algorithms aim to help robots achieve task-level goals, while maintaining motion-level feasibility. This paper focuses on TAMP domains that involve robot behaviors that take extended periods of time (e.g., long-distance navigation). In this paper, we develop a visual grounding approach to help robots probabilistically evaluate action feasibility, and introduce a TAMP algorithm, called GROP, that optimizes both feasibility and efficiency. We have collected a dataset that includes 96,000 simulated trials of a robot conducting mobile manipulation tasks, and then used the dataset to learn to ground symbolic spatial relationships for action feasibility evaluation. Compared with competitive TAMP baselines, GROP exhibited a higher task-completion rate while maintaining lower or comparable action costs. In addition to these extensive experiments in simulation, GROP is fully implemented and tested on a real robot system.

READ FULL TEXT

page 1

page 2

page 6

research
03/20/2022

Accelerating Integrated Task and Motion Planning with Neural Feasibility Checking

As robots play an increasingly important role in the industrial, the exp...
research
02/14/2022

Learning to Ground Objects for Robot Task and Motion Planning

Task and motion planning (TAMP) algorithms have been developed to help r...
research
07/21/2023

Symbolic State Space Optimization for Long Horizon Mobile Manipulation Planning

In existing task and motion planning (TAMP) research, it is a common ass...
research
04/10/2021

MPTP: Motion-Planning-aware Task Planning for Navigation in Belief Space

We present an integrated Task-Motion Planning (TMP) framework for naviga...
research
11/21/2018

Integrating Task-Motion Planning with Reinforcement Learning for Robust Decision Making in Mobile Robots

Task-motion planning (TMP) addresses the problem of efficiently generati...
research
10/06/2022

Cloud Hopping; Navigating in 3D Uneven Environments via Supervoxels and Control Lyapunov Function

This paper presents a novel feedback motion planning method for mobile r...
research
10/02/2019

Deploying the NASA Valkyrie Humanoid for IED Response: An Initial Approach and Evaluation Summary

As part of a feasibility study, this paper shows the NASA Valkyrie human...

Please sign up or login with your details

Forgot password? Click here to reset