SDOF-Tracker: Fast and Accurate Multiple Human Tracking by Skipped-Detection and Optical-Flow

by   Hitoshi Nishimura, et al.

Multiple human tracking is a fundamental problem for scene understanding. Although both accuracy and speed are required in real-world applications, recent tracking methods based on deep learning have focused on accuracy and require substantial running time. This study aims to improve running speed by performing human detection at a certain frame interval because it accounts for most of the running time. The question is how to maintain accuracy while skipping human detection. In this paper, we propose a method that complements the detection results with optical flow, based on the fact that someone's appearance does not change much between adjacent frames. To maintain the tracking accuracy, we introduce robust interest point selection within human regions and a tracking termination metric calculated by the distribution of the interest points. On the MOT20 dataset in the MOTChallenge, the proposed SDOF-Tracker achieved the best performance in terms of the total running speed while maintaining the MOTA metric. Our code is available at



There are no comments yet.


page 6


A Framework for Real-Time Face and Facial Feature Tracking using Optical Flow Pre-estimation and Template Tracking

This work presents a framework for tracking head movements and capturing...

Learning Human Optical Flow

The optical flow of humans is well known to be useful for the analysis o...

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression

In recent years, several progressive works promote the development of ae...

Multi-Object Tracking and Segmentation with a Space-Time Memory Network

We propose a method for multi-object tracking and segmentation that does...

Confidence Trigger Detection: An Approach to Build Real-time Tracking-by-detection System

With deep learning based image analysis getting popular in recent years,...

Superpixels Based Marker Tracking Vs. Hue Thresholding In Rodent Biomechanics Application

Examining locomotion has improved our basic understanding of motor contr...

3D Based Landmark Tracker Using Superpixels Based Segmentation for Neuroscience and Biomechanics Studies

Examining locomotion has improved our basic understanding of motor contr...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.