Distributional Instance Segmentation: Modeling Uncertainty and High Confidence Predictions with Latent-MaskRCNN

05/03/2023
by   YuXuan Liu, et al.
0

Object recognition and instance segmentation are fundamental skills in any robotic or autonomous system. Existing state-of-the-art methods are often unable to capture meaningful uncertainty in challenging or ambiguous scenes, and as such can cause critical errors in high-performance applications. In this paper, we explore a class of distributional instance segmentation models using latent codes that can model uncertainty over plausible hypotheses of object masks. For robotic picking applications, we propose a confidence mask method to achieve the high precision necessary in industrial use cases. We show that our method can significantly reduce critical errors in robotic systems, including our newly released dataset of ambiguous scenes in a robotic application. On a real-world apparel-picking robot, our method significantly reduces double pick errors while maintaining high performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 9

research
03/25/2023

UnScene3D: Unsupervised 3D Instance Segmentation for Indoor Scenes

3D instance segmentation is fundamental to geometric understanding of th...
research
05/10/2023

Self-Supervised Instance Segmentation by Grasping

Instance segmentation is a fundamental skill for many robotic applicatio...
research
11/22/2021

Depth-aware Object Segmentation and Grasp Detection for Robotic Picking Tasks

In this paper, we present a novel deep neural network architecture for j...
research
05/27/2019

Straight to Shapes++: Real-time Instance Segmentation Made More Accurate

Instance segmentation is an important problem in computer vision, with a...
research
07/24/2018

ClusterNet: Instance Segmentation in RGB-D Images

We propose a method for instance-level segmentation that uses RGB-D data...
research
07/04/2022

Beyond mAP: Re-evaluating and Improving Performance in Instance Segmentation with Semantic Sorting and Contrastive Flow

Top-down instance segmentation methods improve mAP by hedging bets on lo...
research
10/15/2020

Pick-Place With Uncertain Object Instance Segmentation and Shape Completion

In this paper we consider joint perception and control of a pick-place s...

Please sign up or login with your details

Forgot password? Click here to reset