Bootstrapping Robotic Ecological Perception from a Limited Set of Hypotheses Through Interactive Perception

01/30/2019
by   Léni K. Le Goff, et al.
0

To solve its task, a robot needs to have the ability to interpret its perceptions. In vision, this interpretation is particularly difficult and relies on the understanding of the structure of the scene, at least to the extent of its task and sensorimotor abilities. A robot with the ability to build and adapt this interpretation process according to its own tasks and capabilities would push away the limits of what robots can achieve in a non controlled environment. A solution is to provide the robot with processes to build such representations that are not specific to an environment or a situation. A lot of works focus on objects segmentation, recognition and manipulation. Defining an object solely on the basis of its visual appearance is challenging given the wide range of possible objects and environments. Therefore, current works make simplifying assumptions about the structure of a scene. Such assumptions reduce the adaptivity of the object extraction process to the environments in which the assumption holds. To limit such assumptions, we introduce an exploration method aimed at identifying moveable elements in a scene without considering the concept of object. By using the interactive perception framework, we aim at bootstrapping the acquisition process of a representation of the environment with a minimum of context specific assumptions. The robotic system builds a perceptual map called relevance map which indicates the moveable parts of the current scene. A classifier is trained online to predict the category of each region (moveable or non-moveable). It is also used to select a region with which to interact, with the goal of minimizing the uncertainty of the classification. A specific classifier is introduced to fit these needs: the collaborative mixture models classifier. The method is tested on a set of scenarios of increasing complexity, using both simulations and a PR2 robot.

READ FULL TEXT

page 1

page 6

page 8

page 13

page 14

page 17

page 19

research
03/11/2019

Building an Affordances Map with Interactive Perception

Robots need to understand their environment to perform their task. If it...
research
03/28/2019

Amortized Object and Scene Perception for Long-term Robot Manipulation

Mobile robots, performing long-term manipulation activities in human env...
research
11/18/2019

Object Finding in Cluttered Scenes Using Interactive Perception

Object finding in clutter is a skill that requires both perception of th...
research
09/11/2020

The Robotic Vision Scene Understanding Challenge

Being able to explore an environment and understand the location and typ...
research
11/23/2020

Imagination-enabled Robot Perception

Many of today's robot perception systems aim at accomplishing perception...
research
07/19/2023

Object-centric Representations for Interactive Online Learning with Non-Parametric Methods

Large offline learning-based models have enabled robots to successfully ...
research
10/03/2018

Grounding Perception: A Developmental Approach to Sensorimotor Contingencies

Sensorimotor contingency theory offers a promising account of the nature...

Please sign up or login with your details

Forgot password? Click here to reset