Learnable Online Graph Representations for 3D Multi-Object Tracking

by   Jan-Nico Zaech, et al.

Tracking of objects in 3D is a fundamental task in computer vision that finds use in a wide range of applications such as autonomous driving, robotics or augmented reality. Most recent approaches for 3D multi object tracking (MOT) from LIDAR use object dynamics together with a set of handcrafted features to match detections of objects. However, manually designing such features and heuristics is cumbersome and often leads to suboptimal performance. In this work, we instead strive towards a unified and learning based approach to the 3D MOT problem. We design a graph structure to jointly process detection and track states in an online manner. To this end, we employ a Neural Message Passing network for data association that is fully trainable. Our approach provides a natural way for track initialization and handling of false positive detections, while significantly improving track stability. We show the merit of the proposed approach on the publicly available nuScenes dataset by achieving state-of-the-art performance of 65.6


Multi-Object Tracking and Segmentation via Neural Message Passing

Graphs offer a natural way to formulate Multiple Object Tracking (MOT) a...

Probabilistic 3D Multi-Modal, Multi-Object Tracking for Autonomous Driving

Multi-object tracking is an important ability for an autonomous vehicle ...

Deep Continuous Conditional Random Fields with Asymmetric Inter-object Constraints for Online Multi-object Tracking

Online Multi-Object Tracking (MOT) is a challenging problem and has many...

Learning a Neural Solver for Multiple Object Tracking

Graphs offer a natural way to formulate Multiple Object Tracking (MOT) w...

TrackMPNN: A Message Passing Graph Neural Architecture for Multi-Object Tracking

This study follows many previous approaches to multi-object tracking (MO...

AutoSelect: Automatic and Dynamic Detection Selection for 3D Multi-Object Tracking

3D multi-object tracking is an important component in robotic perception...

Physics and Human-Based Information Fusion for Improved Resident Space Object Tracking

Maintaining a catalog of Resident Space Objects (RSOs) can be cast in a ...