A Road-map to Robot Task Execution with the Functional Object-Oriented Network

06/01/2021
by   David Paulius, et al.
11

Following work on joint object-action representations, the functional object-oriented network (FOON) was introduced as a knowledge graph representation for robots. Taking the form of a bipartite graph, a FOON contains symbolic or high-level information that would be pertinent to a robot's understanding of its environment and tasks in a way that mirrors human understanding of actions. In this work, we outline a road-map for future development of FOON and its application in robotic systems for task planning as well as knowledge acquisition from demonstration. We propose preliminary ideas to show how a FOON can be created in a real-world scenario with a robot and human teacher in a way that can jointly augment existing knowledge in a FOON and teach a robot the skills it needs to replicate the demonstrated actions and solve a given manipulation problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2022

Long-Horizon Task and Motion Planning with Functional Object-Oriented Networks

Following work on joint object-action representations, functional object...
research
06/01/2021

Evaluating Recipes Generated from Functional Object-Oriented Network

The functional object-oriented network (FOON) has been introduced as a k...
research
05/01/2019

Functional Object-Oriented Network: Considering Robot's Capability in Human-Robot Collaboration

In this work, we explore human-robot collaborative planning using the fu...
research
12/04/2021

Functional Task Tree Generation from a Knowledge Graph to Solve Unseen Problems

A major component for developing intelligent and autonomous robots is a ...
research
10/13/2022

FOON Creation and Traversal for Recipe Generation

Task competition by robots is still off from being completely dependable...
research
07/08/2022

Approximate Task Tree Retrieval in a Knowledge Network for Robotic Cooking

Flexible task planning continues to pose a difficult challenge for robot...
research
10/15/2022

A User Interface for Sense-making of the Reasoning Process while Interacting with Robots

As knowledge graph has the potential to bridge the gap between commonsen...

Please sign up or login with your details

Forgot password? Click here to reset