ClickBAIT-v2: Training an Object Detector in Real-Time

03/27/2018
by   Ervin Teng, et al.
0

Modern deep convolutional neural networks (CNNs) for image classification and object detection are often trained offline on large static datasets. Some applications, however, will require training in real-time on live video streams with a human-in-the-loop. We refer to this class of problem as time-ordered online training (ToOT). These problems will require a consideration of not only the quantity of incoming training data, but the human effort required to annotate and use it. We demonstrate and evaluate a system tailored to training an object detector on a live video stream with minimal input from a human operator. We show that we can obtain bounding box annotation from weakly-supervised single-point clicks through interactive segmentation. Furthermore, by exploiting the time-ordered nature of the video stream through object tracking, we can increase the average training benefit of human interactions by 3-4 times.

READ FULL TEXT

page 4

page 5

page 6

page 7

research
09/15/2017

ClickBAIT: Click-based Accelerated Incremental Training of Convolutional Neural Networks

Today's general-purpose deep convolutional neural networks (CNN) for ima...
research
12/12/2018

Fast Online Object Tracking and Segmentation: A Unifying Approach

In this paper we illustrate how to perform both visual object tracking a...
research
06/21/2020

Semi-Supervised Object Detection with Sparsely Annotated Dataset

In training object detector based on convolutional neural networks, sele...
research
08/16/2020

Time-Supervised Primary Object Segmentation

We describe an unsupervised method to detect and segment portions of liv...
research
03/24/2021

TagMe: GPS-Assisted Automatic Object Annotation in Videos

Training high-accuracy object detection models requires large and divers...
research
06/21/2018

Inference of Quantized Neural Networks on Heterogeneous All-Programmable Devices

Neural networks have established as a generic and powerful means to appr...
research
08/29/2021

Autonomous Curiosity for Real-Time Training Onboard Robotic Agents

Learning requires both study and curiosity. A good learner is not only g...

Please sign up or login with your details

Forgot password? Click here to reset