DeComplex: Task planning from complex natural instructions by a collocating robot

08/23/2020
by   Pradip Pramanick, et al.
3

As the number of robots in our daily surroundings like home, office, restaurants, factory floors, etc. are increasing rapidly, the development of natural human-robot interaction mechanism becomes more vital as it dictates the usability and acceptability of the robots. One of the valued features of such a cohabitant robot is that it performs tasks that are instructed in natural language. However, it is not trivial to execute the human intended tasks as natural language expressions can have large linguistic variations. Existing works assume either single task instruction is given to the robot at a time or there are multiple independent tasks in an instruction. However, complex task instructions composed of multiple inter-dependent tasks are not handled efficiently in the literature. There can be ordering dependency among the tasks, i.e., the tasks have to be executed in a certain order or there can be execution dependency, i.e., input parameter or execution of a task depends on the outcome of another task. Understanding such dependencies in a complex instruction is not trivial if an unconstrained natural language is allowed. In this work, we propose a method to find the intended order of execution of multiple inter-dependent tasks given in natural language instruction. Based on our experiment, we show that our system is very accurate in generating a viable execution plan from a complex instruction.

READ FULL TEXT
research
03/05/2020

Your instruction may be crisp, but not clear to me!

The number of robots deployed in our daily surroundings is ever-increasi...
research
06/03/2021

Learning and Executing Re-usable Behaviour Trees from Natural Language Instruction

Domestic and service robots have the potential to transform industries s...
research
04/02/2022

Moment-based Adversarial Training for Embodied Language Comprehension

In this paper, we focus on a vision-and-language task in which a robot i...
research
08/23/2020

Enabling human-like task identification from natural conversation

A robot as a coworker or a cohabitant is becoming mainstream day-by-day ...
research
07/12/2021

A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Execution

Natural language provides an accessible and expressive interface to spec...
research
01/30/2017

A Review of Methodologies for Natural-Language-Facilitated Human-Robot Cooperation

Natural-language-facilitated human-robot cooperation (NLC) refers to usi...
research
11/22/2021

Talk-to-Resolve: Combining scene understanding and spatial dialogue to resolve granular task ambiguity for a collocated robot

The utility of collocating robots largely depends on the easy and intuit...

Please sign up or login with your details

Forgot password? Click here to reset