PointIT: A Fast Tracking Framework Based on 3D Instance Segmentation

02/18/2019
by   Yuan Wang, et al.
0

Recently most popular tracking frameworks focus on 2D image sequences. They seldom track the 3D object in point clouds. In this paper, we propose PointIT, a fast, simple tracking method based on 3D on-road instance segmentation. Firstly, we transform 3D LiDAR data into the spherical image with the size of 64 x 512 x 4 and feed it into instance segment model to get the predicted instance mask for each class. Then we use MobileNet as our primary encoder instead of the original ResNet to reduce the computational complexity. Finally, we extend the Sort algorithm with this instance framework to realize tracking in the 3D LiDAR point cloud data. The model is trained on the spherical images dataset with the corresponding instance label masks which are provided by KITTI 3D Object Track dataset. According to the experiment results, our network can achieve on Average Precision (AP) of 0.617 and the performance of multi-tracking task has also been improved.

READ FULL TEXT

page 2

page 5

page 6

research
07/17/2018

PointSeg: Real-Time Semantic Segmentation Based on 3D LiDAR Point Cloud

In this paper, we propose PointSeg, a real-time end-to-end semantic segm...
research
05/11/2023

FreePoint: Unsupervised Point Cloud Instance Segmentation

Instance segmentation of point clouds is a crucial task in 3D field with...
research
03/11/2021

Instance Segmentation GNNs for One-Shot Conformal Tracking at the LHC

3D instance segmentation remains a challenging problem in computer visio...
research
05/02/2022

RangeSeg: Range-Aware Real Time Segmentation of 3D LiDAR Point Clouds

Semantic outdoor scene understanding based on 3D LiDAR point clouds is a...
research
06/08/2017

Automatic tracking of vessel-like structures from a single starting point

The identification of vascular networks is an important topic in the med...
research
04/01/2021

Learning to Track Instances without Video Annotations

Tracking segmentation masks of multiple instances has been intensively s...
research
11/05/2019

Recurrent Instance Segmentation using Sequences of Referring Expressions

The goal of this work is to segment the objects in an image that are ref...

Please sign up or login with your details

Forgot password? Click here to reset