DirectTracker: 3D Multi-Object Tracking Using Direct Image Alignment and Photometric Bundle Adjustment

09/29/2022
by   Mariia Gladkova, et al.
0

Direct methods have shown excellent performance in the applications of visual odometry and SLAM. In this work we propose to leverage their effectiveness for the task of 3D multi-object tracking. To this end, we propose DirectTracker, a framework that effectively combines direct image alignment for the short-term tracking and sliding-window photometric bundle adjustment for 3D object detection. Object proposals are estimated based on the sparse sliding-window pointcloud and further refined using an optimization-based cost function that carefully combines 3D and 2D cues to ensure consistency in image and world space. We propose to evaluate 3D tracking using the recently introduced higher-order tracking accuracy (HOTA) metric and the generalized intersection over union similarity measure to mitigate the limitations of the conventional use of intersection over union for the evaluation of vision-based trackers. We perform evaluation on the KITTI Tracking benchmark for the Car class and show competitive performance in tracking objects both in 2D and 3D.

READ FULL TEXT
research
12/05/2022

DL-SLOT: Dynamic LiDAR SLAM and object tracking based on collaborative graph optimization

Ego-pose estimation and dynamic object tracking are two critical problem...
research
11/28/2015

Sliding-Window Optimization on an Ambiguity-Clearness Graph for Multi-object Tracking

Multi-object tracking remains challenging due to frequent occurrence of ...
research
09/16/2020

HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking

Multi-Object Tracking (MOT) has been notoriously difficult to evaluate. ...
research
02/23/2022

DL-SLOT: Dynamic Lidar SLAM and Object Tracking Based On Graph Optimization

Ego-pose estimation and dynamic object tracking are two key issues in an...
research
09/08/2022

PixTrack: Precise 6DoF Object Pose Tracking using NeRF Templates and Feature-metric Alignment

We present PixTrack, a vision based object pose tracking framework using...
research
06/19/2022

mvHOTA: A multi-view higher order tracking accuracy metric to measure spatial and temporal associations in multi-point detection

Multi-object tracking (MOT) is a challenging task that involves detectin...
research
09/05/2021

Square Root Marginalization for Sliding-Window Bundle Adjustment

In this paper we propose a novel square root sliding-window bundle adjus...

Please sign up or login with your details

Forgot password? Click here to reset