Training and Testing Object Detectors with Virtual Images

by   Yonglin Tian, et al.

In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world has a great demand for labor and money investments and is usually too passive to build datasets with specific characteristics, such as small area of objects and high occlusion level. Under the framework of Parallel Vision, this paper presents a purposeful way to design artificial scenes and automatically generate virtual images with precise annotations. A virtual dataset named ParallelEye is built, which can be used for several computer vision tasks. Then, by training the DPM (Deformable Parts Model) and Faster R-CNN detectors, we prove that the performance of models can be significantly improved by combining ParallelEye with publicly available real-world datasets during the training phase. In addition, we investigate the potential of testing the trained models from a specific aspect using intentionally designed virtual datasets, in order to discover the flaws of trained models. From the experimental results, we conclude that our virtual dataset is viable to train and test the object detectors.


page 3

page 4

page 6

page 8


Synthesizing Training Data for Object Detection in Indoor Scenes

Detection of objects in cluttered indoor environments is one of the key ...

Scene-Specific Pedestrian Detection Based on Parallel Vision

As a special type of object detection, pedestrian detection in generic s...

CrowdSim2: an Open Synthetic Benchmark for Object Detectors

Data scarcity has become one of the main obstacles to developing supervi...

The ParallelEye Dataset: Constructing Large-Scale Artificial Scenes for Traffic Vision Research

Video image datasets are playing an essential role in design and evaluat...

Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?

Deep learning has rapidly transformed the state of the art algorithms us...

DEArt: Dataset of European Art

Large datasets that were made publicly available to the research communi...

Assessing a mobile-based deep learning model for plant disease surveillance

Convolutional neural network models (CNNs) have made major advances in c...

Please sign up or login with your details

Forgot password? Click here to reset