EXPO-HD: Exact Object Perception using High Distraction Synthetic Data

07/28/2020
by   Roey Ron, et al.
0

We present a new labeled visual dataset intended for use in object detection and segmentation tasks. This dataset consists of 5,000 synthetic photorealistic images with their corresponding pixel-perfect segmentation ground truth. The goal is to create a photorealistic 3D representation of a specific object and utilize it within a simulated training data setting to achieve high accuracy on manually gathered and annotated real-world data. Expo Markers were chosen for this task, fitting our requirements of an exact object due to the exact texture, size and 3D shape. An additional advantage is the availability of this object in offices around the world for easy testing and validation of our results. We generate the data using a domain randomization technique that also simulates other photorealistic objects in the scene, known as distraction objects. These objects provide visual complexity, occlusions, and lighting challenges to help our model gain robustness in training. We are also releasing our manually-labeled real-image test dataset. This white-paper provides strong evidence that photorealistic simulated data can be used in practical real world applications as a more scalable and flexible solution than manually-captured data. https://github.com/DataGenResearchTeam/expo_markers

READ FULL TEXT

page 1

page 3

page 4

page 11

page 12

research
09/22/2020

PennSyn2Real: Training Object Recognition Models without Human Labeling

Scalability is a critical problem in generating training images for deep...
research
08/12/2020

SIDOD: A Synthetic Image Dataset for 3D Object Pose Recognition with Distractors

We present a new, publicly-available image dataset generated by the NVID...
research
11/29/2022

Analysis of Training Object Detection Models with Synthetic Data

Recently, the use of synthetic training data has been on the rise as it ...
research
03/24/2022

Learning Dense Correspondence from Synthetic Environments

Estimation of human shape and pose from a single image is a challenging ...
research
02/26/2023

Perceiving Unseen 3D Objects by Poking the Objects

We present a novel approach to interactive 3D object perception for robo...
research
11/15/2022

Data-Driven Occupancy Grid Mapping using Synthetic and Real-World Data

In perception tasks of automated vehicles (AVs) data-driven have often o...
research
08/21/2023

The Change You Want to See (Now in 3D)

The goal of this paper is to detect what has changed, if anything, betwe...

Please sign up or login with your details

Forgot password? Click here to reset