Supervised Training of Dense Object Nets using Optimal Descriptors for Industrial Robotic Applications

02/16/2021
by   Andras Kupcsik, et al.
0

Dense Object Nets (DONs) by Florence, Manuelli and Tedrake (2018) introduced dense object descriptors as a novel visual object representation for the robotics community. It is suitable for many applications including object grasping, policy learning, etc. DONs map an RGB image depicting an object into a descriptor space image, which implicitly encodes key features of an object invariant to the relative camera pose. Impressively, the self-supervised training of DONs can be applied to arbitrary objects and can be evaluated and deployed within hours. However, the training approach relies on accurate depth images and faces challenges with small, reflective objects, typical for industrial settings, when using consumer grade depth cameras. In this paper we show that given a 3D model of an object, we can generate its descriptor space image, which allows for supervised training of DONs. We rely on Laplacian Eigenmaps (LE) to embed the 3D model of an object into an optimally generated space. While our approach uses more domain knowledge, it can be efficiently applied even for smaller and reflective objects, as it does not rely on depth information. We compare the training methods on generating 6D grasps for industrial objects and show that our novel supervised training approach improves the pick-and-place performance in industry-relevant tasks.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

research
06/22/2018

Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation

What is the right object representation for manipulation? We would like ...
research
10/05/2021

Fully Self-Supervised Class Awareness in Dense Object Descriptors

We address the problem of inferring self-supervised dense semantic corre...
research
09/12/2022

Learning Dense Visual Descriptors using Image Augmentations for Robot Manipulation Tasks

We propose a self-supervised training approach for learning view-invaria...
research
03/03/2022

NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields

Thin, reflective objects such as forks and whisks are common in our dail...
research
04/18/2023

Learning Sim-to-Real Dense Object Descriptors for Robotic Manipulation

It is crucial to address the following issues for ubiquitous robotics ma...
research
06/24/2022

Efficient and Robust Training of Dense Object Nets for Multi-Object Robot Manipulation

We propose a framework for robust and efficient training of Dense Object...
research
01/31/2016

Bit-Planes: Dense Subpixel Alignment of Binary Descriptors

Binary descriptors have been instrumental in the recent evolution of com...

Please sign up or login with your details

Forgot password? Click here to reset