Interactive Text2Pickup Network for Natural Language based Human-Robot Collaboration

05/28/2018
by   Hyemin Ahn, et al.
0

In this paper, we propose the Interactive Text2Pickup (IT2P) network for human-robot collaboration which enables an effective interaction with a human user despite the ambiguity in user's commands. We focus on the task where a robot is expected to pick up an object instructed by a human, and to interact with the human when the given instruction is vague. The proposed network understands the command from the human user and estimates the position of the desired object first. To handle the inherent ambiguity in human language commands, a suitable question which can resolve the ambiguity is generated. The user's answer to the question is combined with the initial command and given back to the network, resulting in more accurate estimation. The experiment results show that given unambiguous commands, the proposed method can estimate the position of the requested object with an accuracy of 98.49 test dataset. Given ambiguous language commands, we show that the accuracy of the pick up task increases by 1.94 times after incorporating the information obtained from the interaction.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 8

research
09/14/2023

PROGrasp: Pragmatic Human-Robot Communication for Object Grasping

Interactive Object Grasping (IOG) is the task of identifying and graspin...
research
06/17/2023

CLARA: Classifying and Disambiguating User Commands for Reliable Interactive Robotic Agents

In this paper, we focus on inferring whether the given user command is c...
research
11/22/2021

Talk-to-Resolve: Combining scene understanding and spatial dialogue to resolve granular task ambiguity for a collocated robot

The utility of collocating robots largely depends on the easy and intuit...
research
12/16/2019

Conflict Detection and Resolution in Table Top Scenarios for Human-Robot Interaction

As in any interaction process, misunderstandings, ambiguity, and failure...
research
07/28/2022

DoRO: Disambiguation of referred object for embodied agents

Robotic task instructions often involve a referred object that the robot...
research
07/16/2020

Enabling Morally Sensitive Robotic Clarification Requests

The design of current natural language oriented robot architectures enab...
research
03/05/2020

Your instruction may be crisp, but not clear to me!

The number of robots deployed in our daily surroundings is ever-increasi...

Please sign up or login with your details

Forgot password? Click here to reset