Functional Task Tree Generation from a Knowledge Graph to Solve Unseen Problems

12/04/2021
by   Md Sadman Sakib, et al.
2

A major component for developing intelligent and autonomous robots is a suitable knowledge representation, from which a robot can acquire knowledge about its actions or world. However, unlike humans, robots cannot creatively adapt to novel scenarios, as their knowledge and environment are rigidly defined. To address the problem of producing novel and flexible task plans called task trees, we explore how we can derive plans with concepts not originally in the robot's knowledge base. Existing knowledge in the form of a knowledge graph is used as a base of reference to create task trees that are modified with new object or state combinations. To demonstrate the flexibility of our method, we randomly selected recipes from the Recipe1M+ dataset and generated their task trees. The task trees were then thoroughly checked with a visualization tool that portrays how each ingredient changes with each action to produce the desired meal. Our results indicate that the proposed method can produce task plans with high accuracy even for never-before-seen ingredient combinations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2022

Approximate Task Tree Retrieval in a Knowledge Network for Robotic Cooking

Flexible task planning continues to pose a difficult challenge for robot...
research
07/12/2022

Long-Horizon Task and Motion Planning with Functional Object-Oriented Networks

Following work on joint object-action representations, functional object...
research
06/01/2021

A Road-map to Robot Task Execution with the Functional Object-Oriented Network

Following work on joint object-action representations, the functional ob...
research
06/01/2021

Evaluating Recipes Generated from Functional Object-Oriented Network

The functional object-oriented network (FOON) has been introduced as a k...
research
11/06/2022

Knowledge Retrieval using Foon

Flexible task planning is still a significant challenge for robots. The ...
research
06/18/2022

ToolTango: Common sense Generalization in Predicting Sequential Tool Interactions for Robot Plan Synthesis

Robots assisting us in environments such as factories or homes must lear...
research
05/05/2021

TANGO: Commonsense Generalization in Predicting Tool Interactions for Mobile Manipulators

Robots assisting us in factories or homes must learn to make use of obje...

Please sign up or login with your details

Forgot password? Click here to reset