Point Cloud Registration-Driven Robust Feature Matching for 3D Siamese Object Tracking

09/14/2022
by   Haobo Jiang, et al.
0

Learning robust feature matching between the template and search area is crucial for 3D Siamese tracking. The core of Siamese feature matching is how to assign high feature similarity on the corresponding points between the template and search area for precise object localization. In this paper, we propose a novel point cloud registration-driven Siamese tracking framework, with the intuition that spatially aligned corresponding points (via 3D registration) tend to achieve consistent feature representations. Specifically, our method consists of two modules, including a tracking-specific nonlocal registration module and a registration-aided Sinkhorn template-feature aggregation module. The registration module targets at the precise spatial alignment between the template and search area. The tracking-specific spatial distance constraint is proposed to refine the cross-attention weights in the nonlocal module for discriminative feature learning. Then, we use the weighted SVD to compute the rigid transformation between the template and search area, and align them to achieve the desired spatially aligned corresponding points. For the feature aggregation model, we formulate the feature matching between the transformed template and search area as an optimal transport problem and utilize the Sinkhorn optimization to search for the outlier-robust matching solution. Also, a registration-aided spatial distance map is built to improve the matching robustness in indistinguishable regions (e.g., smooth surface). Finally, guided by the obtained feature matching map, we aggregate the target information from the template into the search area to construct the target-specific feature, which is then fed into a CenterPoint-like detection head for object localization. Extensive experiments on KITTI, NuScenes and Waymo datasets verify the effectiveness of our proposed method.

READ FULL TEXT

page 1

page 3

page 4

research
08/24/2023

Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Tracking

Siamese network has been a de facto benchmark framework for 3D LiDAR obj...
research
02/12/2023

Large-scale Point Cloud Registration Based on Graph Matching Optimization

Point Clouds Registration is a fundamental and challenging problem in 3D...
research
06/25/2019

Road-network-based Rapid Geolocalization

It has always been a research hotspot to use geographic information to a...
research
02/23/2022

Reliable Inlier Evaluation for Unsupervised Point Cloud Registration

Unsupervised point cloud registration algorithm usually suffers from the...
research
11/08/2021

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds

3D object tracking in point clouds is still a challenging problem due to...
research
01/28/2023

Object Preserving Siamese Network for Single Object Tracking on Point Clouds

Obviously, the object is the key factor of the 3D single object tracking...
research
07/28/2016

Video Registration in Egocentric Vision under Day and Night Illumination Changes

With the spread of wearable devices and head mounted cameras, a wide ran...

Please sign up or login with your details

Forgot password? Click here to reset