Long-Horizon Task and Motion Planning with Functional Object-Oriented Networks

07/12/2022
by   David Paulius, et al.
0

Following work on joint object-action representations, functional object-oriented networks (FOON) were introduced as a knowledge graph representation for robots. Taking the form of a bipartite graph, a FOON contains symbolic (high-level) concepts useful to a robot's understanding of tasks and its environment for object-level planning. Prior to this paper, little has been done to demonstrate how task plans acquired from FOON via task tree retrieval can be executed by a robot, as the concepts in a FOON are too abstract for immediate execution. We propose a hierarchical task planning approach that translates a FOON graph into a PDDL-based representation of domain knowledge for manipulation planning. As a result of this process, a task plan can be acquired that a robot can execute from start to end, leveraging the use of action contexts and skills in the form of dynamic movement primitives (DMP). We demonstrate the entire pipeline from planning to execution using CoppeliaSim and show how learned action contexts can be extended to never-before-seen scenarios.

READ FULL TEXT
research
06/01/2021

A Road-map to Robot Task Execution with the Functional Object-Oriented Network

Following work on joint object-action representations, the functional ob...
research
07/05/2018

A Survey of Knowledge Representation and Retrieval for Learning in Service Robotics

Within the realm of service robotics, researchers have placed a great am...
research
12/04/2021

Functional Task Tree Generation from a Knowledge Graph to Solve Unseen Problems

A major component for developing intelligent and autonomous robots is a ...
research
07/03/2018

Long Activity Video Understanding using Functional Object-Oriented Network

Video understanding is one of the most challenging topics in computer vi...
research
07/08/2022

Approximate Task Tree Retrieval in a Knowledge Network for Robotic Cooking

Flexible task planning continues to pose a difficult challenge for robot...
research
11/06/2022

Knowledge Retrieval using Foon

Flexible task planning is still a significant challenge for robots. The ...

Please sign up or login with your details

Forgot password? Click here to reset