Fully Self-Supervised Class Awareness in Dense Object Descriptors

10/05/2021
by   Denis Hadjivelichkov, et al.
0

We address the problem of inferring self-supervised dense semantic correspondences between objects in multi-object scenes. The method introduces learning of class-aware dense object descriptors by providing either unsupervised discrete labels or confidence in object similarities. We quantitatively and qualitatively show that the introduced method outperforms previous techniques with more robust pixel-to-pixel matches. An example robotic application is also shown - grasping of objects in clutter based on corresponding points.

READ FULL TEXT

page 1

page 5

page 6

page 7

page 8

research
06/22/2018

Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulation

What is the right object representation for manipulation? We would like ...
research
12/10/2021

Deep ViT Features as Dense Visual Descriptors

We leverage deep features extracted from a pre-trained Vision Transforme...
research
02/16/2021

Supervised Training of Dense Object Nets using Optimal Descriptors for Industrial Robotic Applications

Dense Object Nets (DONs) by Florence, Manuelli and Tedrake (2018) introd...
research
11/28/2022

Learning Dense Object Descriptors from Multiple Views for Low-shot Category Generalization

A hallmark of the deep learning era for computer vision is the successfu...
research
03/03/2022

NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields

Thin, reflective objects such as forks and whisks are common in our dail...
research
10/09/2020

MMGSD: Multi-Modal Gaussian Shape Descriptors for Correspondence Matching in 1D and 2D Deformable Objects

We explore learning pixelwise correspondences between images of deformab...
research
04/24/2015

Semantic Motion Segmentation Using Dense CRF Formulation

While the literature has been fairly dense in the areas of scene underst...

Please sign up or login with your details

Forgot password? Click here to reset