Efficient Tracking Proposals using 2D-3D Siamese Networks on LIDAR

03/25/2019
by   Jesus Zarzar, et al.
0

Tracking vehicles in LIDAR point clouds is a challenging task due to the sparsity of the data and the dense search space. The lack of structure in point clouds impedes the use of convolution and correlation filters usually employed in 2D object tracking. In addition, structuring point clouds is cumbersome and implies losing fine-grained information. As a result, generating proposals in 3D space is expensive and inefficient. In this paper, we leverage the dense and structured Bird Eye View (BEV) representation of LIDAR point clouds to efficiently search for objects of interest. We use an efficient Region Proposal Network and generate a small number of object proposals in 3D. Successively, we refine our selection of 3D object candidates by exploiting the similarity capability of a 3D Siamese network. We regularize the latter 3D Siamese network for shape completion to enhance its discrimination capability. Our method attempts to solve both for an efficient search space in the BEV space and a meaningful selection using 3D LIDAR point cloud. We show that the Region Proposal in the BEV outperforms Bayesian methods such as Kalman and Particle Filters in providing proposal by a significant margin and that such candidates are suitable for the 3D Siamese network. By training our method end-to-end, we outperform the previous baseline in vehicle tracking by 12 and Precision when using only 16 candidates.

READ FULL TEXT
research
10/22/2020

F-Siamese Tracker: A Frustum-based Double Siamese Network for 3D Single Object Tracking

This paper presents F-Siamese Tracker, a novel approach for single objec...
research
03/05/2019

Leveraging Shape Completion for 3D Siamese Tracking

Point clouds are challenging to process due to their sparsity, therefore...
research
11/08/2021

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds

3D object tracking in point clouds is still a challenging problem due to...
research
03/03/2022

Beyond 3D Siamese Tracking: A Motion-Centric Paradigm for 3D Single Object Tracking in Point Clouds

3D single object tracking (3D SOT) in LiDAR point clouds plays a crucial...
research
02/28/2022

Towards Class-agnostic Tracking Using Feature Decorrelation in Point Clouds

Single object tracking in point clouds has been attracting more and more...
research
03/02/2022

Learning Moving-Object Tracking with FMCW LiDAR

In this paper, we propose a learning-based moving-object tracking method...
research
01/22/2017

Large Scale Novel Object Discovery in 3D

We present a method for discovering objects in 3D point clouds from sens...

Please sign up or login with your details

Forgot password? Click here to reset