DeepAI AI Chat
Log In Sign Up

Segmenting unseen industrial components in a heavy clutter using rgb-d fusion and synthetic data

by   Seunghyeok Back, et al.

Segmentation of unseen industrial parts is essential for autonomous industrial systems. However, industrial components are texture-less, reflective, and often found in cluttered and unstructured environments with heavy occlusion, which makes it more challenging to deal with unseen objects. To tackle this problem, we propose a synthetic data generation pipeline that randomizes textures via domain randomization to focus on the shape information. In addition, we propose an RGB-D Fusion Mask R-CNN with a confidence map estimator, which exploits reliable depth information in multiple feature levels. We transferred the trained model to real-world scenarios and evaluated its performance by making comparisons with baselines and ablation studies. We demonstrate that our methods, which use only synthetic data, could be effective solutions for unseen industrial components segmentation.


page 1

page 2

page 3

page 4


Unseen Object Instance Segmentation for Robotic Environments

In order to function in unstructured environments, robots need the abili...

The Best of Both Modes: Separately Leveraging RGB and Depth for Unseen Object Instance Segmentation

In order to function in unstructured environments, robots need the abili...

Learning RGB-D Feature Embeddings for Unseen Object Instance Segmentation

Segmenting unseen objects in cluttered scenes is an important skill that...

Unseen Object Instance Segmentation with Fully Test-time RGB-D Embeddings Adaptation

Segmenting unseen objects is a crucial ability for the robot since it ma...

Egocentric Human-Object Interaction Detection Exploiting Synthetic Data

We consider the problem of detecting Egocentric HumanObject Interactions...

Object Detection using Domain Randomization and Generative Adversarial Refinement of Synthetic Images

In this work, we present an application of domain randomization and gene...

Tracking Blobs in the Turbulent Edge Plasma of Tokamak Fusion Reactors

The analysis of turbulent flows is a significant area in fusion plasma p...