Identification of Unmodeled Objects from Symbolic Descriptions

01/23/2017
by   Andrea Baisero, et al.
0

Successful human-robot cooperation hinges on each agent's ability to process and exchange information about the shared environment and the task at hand. Human communication is primarily based on symbolic abstractions of object properties, rather than precise quantitative measures. A comprehensive robotic framework thus requires an integrated communication module which is able to establish a link and convert between perceptual and abstract information. The ability to interpret composite symbolic descriptions enables an autonomous agent to a) operate in unstructured and cluttered environments, in tasks which involve unmodeled or never seen before objects; and b) exploit the aggregation of multiple symbolic properties as an instance of ensemble learning, to improve identification performance even when the individual predicates encode generic information or are imprecisely grounded. We propose a discriminative probabilistic model which interprets symbolic descriptions to identify the referent object contextually w.r.t. the structure of the environment and other objects. The model is trained using a collected dataset of identifications, and its performance is evaluated by quantitative measures and a live demo developed on the PR2 robot platform, which integrates elements of perception, object extraction, object identification and grasping.

READ FULL TEXT

page 1

page 4

page 6

research
01/15/2023

Planning for Learning Object Properties

Autonomous agents embedded in a physical environment need the ability to...
research
09/21/2019

Language-guided Adaptive Perception with Hierarchical Symbolic Representations for Mobile Manipulators

Language is an effective medium for bi-directional communication in huma...
research
03/14/2023

SAILOR: Perceptual Anchoring For Robotic Cognitive Architectures

Symbolic anchoring is a crucial problem in the field of robotics, as it ...
research
10/02/2015

Online Vision- and Action-Based Object Classification Using Both Symbolic and Subsymbolic Knowledge Representations

If a robot is supposed to roam an environment and interact with objects,...
research
10/26/2020

Towards Concept Formation Grounded on Perception and Action of a Mobile Robot

The recognition of objects and, hence, their descriptions must be ground...
research
07/25/2020

Object Handovers: a Review for Robotics

This article surveys the literature on human-robot object handovers. A h...
research
03/03/2021

Cooking Object's State Identification Without Using Pretrained Model

Recently, Robotic Cooking has been a very promising field. To execute a ...

Please sign up or login with your details

Forgot password? Click here to reset