Are we Done with Object Recognition? The iCub robot's Perspective

09/28/2017
by   Giulia Pasquale, et al.
0

We report on an extensive study of the current benefits and limitations of deep learning approaches to robot vision and introduce a novel dataset used for our investigation. To avoid the biases in currently available datasets, we consider a human-robot interaction setting to design a data-acquisition protocol for visual object recognition on the iCub humanoid robot. Considering the performance of off-the-shelf models trained on off-line large-scale image retrieval datasets, we show the necessity for knowledge transfer. Indeed, we analyze different ways in which this last step can be done, and identify the major bottlenecks in robotics scenarios. By studying both object categorization and identification tasks, we highlight the key differences between object recognition in robotics and in image retrieval tasks, for which the considered deep learning approaches have been originally designed. In a nutshell, our results confirm also in the considered setting the remarkable improvements yield by deep learning, while pointing to specific open challenges that need to be addressed for seamless deployment in robotics.

READ FULL TEXT

page 4

page 5

page 23

page 25

research
04/13/2015

Real-world Object Recognition with Off-the-shelf Deep Conv Nets: How Many Objects can iCub Learn?

The ability to visually recognize objects is a fundamental skill for rob...
research
03/04/2020

The iCub multisensor datasets for robot and computer vision applications

This document presents novel datasets, constructed by employing the iCub...
research
05/05/2017

Bridging between Computer and Robot Vision through Data Augmentation: a Case Study on Object Recognition

Despite the impressive progress brought by deep network in visual object...
research
09/07/2015

Hierarchical Deep Learning Architecture For 10K Objects Classification

Evolution of visual object recognition architectures based on Convolutio...
research
03/07/2021

MetaView: Few-shot Active Object Recognition

In robot sensing scenarios, instead of passively utilizing human capture...
research
07/09/2015

Robot In a Room: Toward Perfect Object Recognition in Closed Environments

While general object recognition is still far from being solved, this pa...
research
01/20/2023

Robot Skill Learning Via Classical Robotics-Based Generated Datasets: Advantages, Disadvantages, and Future Improvement

Why do we not profit from our long-existing classical robotics knowledge...

Please sign up or login with your details

Forgot password? Click here to reset