Detect or Track: Towards Cost-Effective Video Object Detection/Tracking

11/13/2018
by   Hao Luo, et al.
6

State-of-the-art object detectors and trackers are developing fast. Trackers are in general more efficient than detectors but bear the risk of drifting. A question is hence raised -- how to improve the accuracy of video object detection/tracking by utilizing the existing detectors and trackers within a given time budget? A baseline is frame skipping -- detecting every N-th frames and tracking for the frames in between. This baseline, however, is suboptimal since the detection frequency should depend on the tracking quality. To this end, we propose a scheduler network, which determines to detect or track at a certain frame, as a generalization of Siamese trackers. Although being light-weight and simple in structure, the scheduler network is more effective than the frame skipping baselines and flow-based approaches, as validated on ImageNet VID dataset in video object detection/tracking.

READ FULL TEXT

page 5

page 7

research
10/11/2017

Detect to Track and Track to Detect

Recent approaches for high accuracy detection and tracking of object cat...
research
06/20/2021

Learning to Track Object Position through Occlusion

Occlusion is one of the most significant challenges encountered by objec...
research
03/16/2021

Track to Detect and Segment: An Online Multi-Object Tracker

Most online multi-object trackers perform object detection stand-alone i...
research
11/27/2018

Integrated Object Detection and Tracking with Tracklet-Conditioned Detection

Accurate detection and tracking of objects is vital for effective video ...
research
01/08/2020

An Analysis of Object Representations in Deep Visual Trackers

Fully convolutional deep correlation networks are integral components of...
research
12/20/2022

Bridging Images and Videos: A Simple Learning Framework for Large Vocabulary Video Object Detection

Scaling object taxonomies is one of the important steps toward a robust ...
research
05/18/2021

Finding a Needle in a Haystack: Tiny Flying Object Detection in 4K Videos using a Joint Detection-and-Tracking Approach

Detecting tiny objects in a high-resolution video is challenging because...

Please sign up or login with your details

Forgot password? Click here to reset