Simultaneous Detection and Tracking with Motion Modelling for Multiple Object Tracking

by   ShiJie Sun, et al.

Deep learning-based Multiple Object Tracking (MOT) currently relies on off-the-shelf detectors for tracking-by-detection.This results in deep models that are detector biased and evaluations that are detector influenced. To resolve this issue, we introduce Deep Motion Modeling Network (DMM-Net) that can estimate multiple objects' motion parameters to perform joint detection and association in an end-to-end manner. DMM-Net models object features over multiple frames and simultaneously infers object classes, visibility, and their motion parameters. These outputs are readily used to update the tracklets for efficient MOT. DMM-Net achieves PR-MOTA score of 12.80 @ 120+ fps for the popular UA-DETRAC challenge, which is better performance and orders of magnitude faster. We also contribute a synthetic large-scale public dataset Omni-MOT for vehicle tracking that provides precise ground-truth annotations to eliminate the detector influence in MOT evaluation. This 14M+ frames dataset is extendable with our public script (Code at Dataset <>, Dataset Recorder <>, Omni-MOT Source <>). We demonstrate the suitability of Omni-MOT for deep learning with DMMNet and also make the source code of our network public.



There are no comments yet.


page 13


Deep Affinity Network for Multiple Object Tracking

Multiple Object Tracking (MOT) plays an important role in solving many f...

Improving Object Detection, Multi-object Tracking, and Re-Identification for Disaster Response Drones

We aim to detect and identify multiple objects using multiple cameras an...

FastTrack: an open-source software for tracking varying numbers of deformable objects

Analyzing the dynamical properties of mobile objects requires to extract...

Track without Appearance: Learn Box and Tracklet Embedding with Local and Global Motion Patterns for Vehicle Tracking

Vehicle tracking is an essential task in the multi-object tracking (MOT)...

Score refinement for confidence-based 3D multi-object tracking

Multi-object tracking is a critical component in autonomous navigation, ...

PP-YOLOv2: A Practical Object Detector

Being effective and efficient is essential to an object detector for pra...

E2ETag: An End-to-End Trainable Method for Generating and Detecting Fiducial Markers

Existing fiducial markers solutions are designed for efficient detection...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.