Enabling human-like task identification from natural conversation

08/23/2020
by   Pradip Pramanick, et al.
2

A robot as a coworker or a cohabitant is becoming mainstream day-by-day with the development of low-cost sophisticated hardware. However, an accompanying software stack that can aid the usability of the robotic hardware remains the bottleneck of the process, especially if the robot is not dedicated to a single job. Programming a multi-purpose robot requires an on the fly mission scheduling capability that involves task identification and plan generation. The problem dimension increases if the robot accepts tasks from a human in natural language. Though recent advances in NLP and planner development can solve a variety of complex problems, their amalgamation for a dynamic robotic task handler is used in a limited scope. Specifically, the problem of formulating a planning problem from natural language instructions is not studied in details. In this work, we provide a non-trivial method to combine an NLP engine and a planner such that a robot can successfully identify tasks and all the relevant parameters and generate an accurate plan for the task. Additionally, some mechanism is required to resolve the ambiguity or missing pieces of information in natural language instruction. Thus, we also develop a dialogue strategy that aims to gather additional information with minimal question-answer iterations and only when it is necessary. This work makes a significant stride towards enabling a human-like task understanding capability in a robot.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/05/2020

Your instruction may be crisp, but not clear to me!

The number of robots deployed in our daily surroundings is ever-increasi...
research
08/23/2020

DeComplex: Task planning from complex natural instructions by a collocating robot

As the number of robots in our daily surroundings like home, office, res...
research
11/22/2021

Talk-to-Resolve: Combining scene understanding and spatial dialogue to resolve granular task ambiguity for a collocated robot

The utility of collocating robots largely depends on the easy and intuit...
research
10/01/2021

TEACh: Task-driven Embodied Agents that Chat

Robots operating in human spaces must be able to engage in natural langu...
research
04/06/2023

Natural Language Robot Programming: NLP integrated with autonomous robotic grasping

In this paper, we present a grammar-based natural language framework for...
research
01/30/2017

A Review of Methodologies for Natural-Language-Facilitated Human-Robot Cooperation

Natural-language-facilitated human-robot cooperation (NLC) refers to usi...
research
02/15/2023

ANSEL Photobot: A Robot Event Photographer with Semantic Intelligence

Our work examines the way in which large language models can be used for...

Please sign up or login with your details

Forgot password? Click here to reset