Co-training for On-board Deep Object Detection

08/12/2020
by   Gabriel Villalonga, et al.
17

Providing ground truth supervision to train visual models has been a bottleneck over the years, exacerbated by domain shifts which degenerate the performance of such models. This was the case when visual tasks relied on handcrafted features and shallow machine learning and, despite its unprecedented performance gains, the problem remains open within the deep learning paradigm due to its data-hungry nature. Best performing deep vision-based object detectors are trained in a supervised manner by relying on human-labeled bounding boxes which localize class instances (i.e.objects) within the training images.Thus, object detection is one of such tasks for which human labeling is a major bottleneck. In this paper, we assess co-training as a semi-supervised learning method for self-labeling objects in unlabeled images, so reducing the human-labeling effort for developing deep object detectors. Our study pays special attention to a scenario involving domain shift; in particular, when we have automatically generated virtual-world images with object bounding boxes and we have real-world images which are unlabeled. Moreover, we are particularly interested in using co-training for deep object detection in the context of driver assistance systems and/or self-driving vehicles. Thus, using well-established datasets and protocols for object detection in these application contexts, we will show how co-training is a paradigm worth to pursue for alleviating object labeling, working both alone and together with task-agnostic domain adaptation.

READ FULL TEXT

page 7

page 8

page 11

page 12

page 13

page 14

research
04/23/2021

Co-training for Deep Object Detection: Comparing Single-modal and Multi-modal Approaches

Top-performing computer vision models are powered by convolutional neura...
research
11/28/2020

Class-agnostic Object Detection

Object detection models perform well at localizing and classifying objec...
research
12/29/2016

From Virtual to Real World Visual Perception using Domain Adaptation -- The DPM as Example

Supervised learning tends to produce more accurate classifiers than unsu...
research
04/11/2023

CrowdSim2: an Open Synthetic Benchmark for Object Detectors

Data scarcity has become one of the main obstacles to developing supervi...
research
07/17/2020

Improving Object Detection with Selective Self-supervised Self-training

We study how to leverage Web images to augment human-curated object dete...
research
09/21/2023

NeuralLabeling: A versatile toolset for labeling vision datasets using Neural Radiance Fields

We present NeuralLabeling, a labeling approach and toolset for annotatin...
research
05/11/2022

Multi-Class 3D Object Detection with Single-Class Supervision

While multi-class 3D detectors are needed in many robotics applications,...

Please sign up or login with your details

Forgot password? Click here to reset