Learning to Ground Objects for Robot Task and Motion Planning

02/14/2022
by   Yan Ding, et al.
0

Task and motion planning (TAMP) algorithms have been developed to help robots plan behaviors in discrete and continuous spaces. Robots face complex real-world scenarios, where it is hardly possible to model all objects or their physical properties for robot planning (e.g., in kitchens or shopping centers). In this paper, we define a new object-centric TAMP problem, where the TAMP robot does not know object properties (e.g., size and weight of blocks). We then introduce Task-Motion Object-Centric planning (TMOC), a grounded TAMP algorithm that learns to ground objects and their physical properties with a physics engine. TMOC is particularly useful for those tasks that involve dynamic complex robot-multi-object interactions that can hardly be modeled beforehand. We have demonstrated and evaluated TMOC in simulation and using a real robot. Results show that TMOC outperforms competitive baselines from the literature in cumulative utility.

READ FULL TEXT

page 1

page 6

page 7

research
10/08/2021

Task Allocation for Multi-Robot Task and Motion Planning: a case for Object Picking in Cluttered Workspaces

We present an AND/OR graph-based, integrated multi-robot task and motion...
research
03/25/2021

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI

We introduce a visually-guided and physics-driven task-and-motion planni...
research
02/22/2022

Visually Grounded Task and Motion Planning for Mobile Manipulation

Task and motion planning (TAMP) algorithms aim to help robots achieve ta...
research
11/27/2017

Randomized Physics-based Motion Planning for Grasping in Cluttered and Uncertain Environments

Planning motions to grasp an object in cluttered and uncertain environme...
research
06/26/2019

From Multi-modal Property Dataset to Robot-centric Conceptual Knowledge About Household Objects

Tool-use applications in robotics require conceptual knowledge about obj...
research
11/04/2022

Achieving mouse-level strategic evasion performance using real-time computational planning

Planning is an extraordinary ability in which the brain imagines and the...
research
10/09/2022

Hypergraph-based Multi-Robot Task and Motion Planning

We present a multi-robot task and motion planning method that, when appl...

Please sign up or login with your details

Forgot password? Click here to reset