Detect or Track: Towards Cost-Effective Video Object Detection/Tracking

by   Hao Luo, et al.
Huazhong University of Science u0026 Technology

State-of-the-art object detectors and trackers are developing fast. Trackers are in general more efficient than detectors but bear the risk of drifting. A question is hence raised -- how to improve the accuracy of video object detection/tracking by utilizing the existing detectors and trackers within a given time budget? A baseline is frame skipping -- detecting every N-th frames and tracking for the frames in between. This baseline, however, is suboptimal since the detection frequency should depend on the tracking quality. To this end, we propose a scheduler network, which determines to detect or track at a certain frame, as a generalization of Siamese trackers. Although being light-weight and simple in structure, the scheduler network is more effective than the frame skipping baselines and flow-based approaches, as validated on ImageNet VID dataset in video object detection/tracking.


page 5

page 7


Detect to Track and Track to Detect

Recent approaches for high accuracy detection and tracking of object cat...

Learning to Track Object Position through Occlusion

Occlusion is one of the most significant challenges encountered by objec...

Track to Detect and Segment: An Online Multi-Object Tracker

Most online multi-object trackers perform object detection stand-alone i...

Integrated Object Detection and Tracking with Tracklet-Conditioned Detection

Accurate detection and tracking of objects is vital for effective video ...

An Analysis of Object Representations in Deep Visual Trackers

Fully convolutional deep correlation networks are integral components of...

Bridging Images and Videos: A Simple Learning Framework for Large Vocabulary Video Object Detection

Scaling object taxonomies is one of the important steps toward a robust ...

Please sign up or login with your details

Forgot password? Click here to reset