3D Siamese Transformer Network for Single Object Tracking on Point Clouds

07/25/2022
by   Le Hui, et al.
0

Siamese network based trackers formulate 3D single object tracking as cross-correlation learning between point features of a template and a search area. Due to the large appearance variation between the template and search area during tracking, how to learn the robust cross correlation between them for identifying the potential target in the search area is still a challenging problem. In this paper, we explicitly use Transformer to form a 3D Siamese Transformer network for learning robust cross correlation between the template and the search area of point clouds. Specifically, we develop a Siamese point Transformer network to learn shape context information of the target. Its encoder uses self-attention to capture non-local information of point clouds to characterize the shape information of the object, and the decoder utilizes cross-attention to upsample discriminative point features. After that, we develop an iterative coarse-to-fine correlation network to learn the robust cross correlation between the template and the search area. It formulates the cross-feature augmentation to associate the template with the potential target in the search area via cross attention. To further enhance the potential target, it employs the ego-feature augmentation that applies self-attention to the local k-NN graph of the feature space to aggregate target features. Experiments on the KITTI, nuScenes, and Waymo datasets show that our method achieves state-of-the-art performance on the 3D single object tracking task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/14/2020

Deformable Siamese Attention Networks for Visual Object Tracking

Siamese-based trackers have achieved excellent performance on visual obj...
research
11/08/2021

3D Siamese Voxel-to-BEV Tracker for Sparse Point Clouds

3D object tracking in point clouds is still a challenging problem due to...
research
10/16/2022

OST: Efficient One-stream Network for 3D Single Object Tracking in Point Clouds

Although recent Siamese network-based trackers have achieved impressive ...
research
11/23/2020

Graph Attention Tracking

Siamese network based trackers formulate the visual tracking task as a s...
research
05/28/2020

P2B: Point-to-Box Network for 3D Object Tracking in Point Clouds

Towards 3D object tracking in point clouds, a novel point-to-box network...
research
01/28/2023

Object Preserving Siamese Network for Single Object Tracking on Point Clouds

Obviously, the object is the key factor of the 3D single object tracking...
research
08/24/2023

Synchronize Feature Extracting and Matching: A Single Branch Framework for 3D Object Tracking

Siamese network has been a de facto benchmark framework for 3D LiDAR obj...

Please sign up or login with your details

Forgot password? Click here to reset