Visual Object Tracking by Segmentation with Graph Convolutional Network

09/05/2020
by   Bo Jiang, et al.
0

Segmentation-based tracking has been actively studied in computer vision and multimedia. Superpixel based object segmentation and tracking methods are usually developed for this task. However, they independently perform feature representation and learning of superpixels which may lead to sub-optimal results. In this paper, we propose to utilize graph convolutional network (GCN) model for superpixel based object tracking. The proposed model provides a general end-to-end framework which integrates i) label linear prediction, and ii) structure-aware feature information of each superpixel together to obtain object segmentation and further improves the performance of tracking. The main benefits of the proposed GCN method have two main aspects. First, it provides an effective end-to-end way to exploit both spatial and temporal consistency constraint for target object segmentation. Second, it utilizes a mixed graph convolution module to learn a context-aware and discriminative feature for superpixel representation and labeling. An effective algorithm has been developed to optimize the proposed model. Extensive experiments on five datasets demonstrate that our method obtains better performance against existing alternative methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 6

07/20/2019

PH-GCN: Person Re-identification with Part-based Hierarchical Graph Convolutional Network

The person re-identification (Re-ID) task requires to robustly extract f...
04/06/2019

Learning Aligned-Spatial Graph Convolutional Networks for Graph Classification

In this paper, we develop a novel Aligned-Spatial Graph Convolutional Ne...
09/30/2020

GCNNMatch: Graph Convolutional Neural Networks for Multi-Object Tracking via Sinkhorn Normalization

This paper proposes a novel method for online Multi-Object Tracking (MOT...
04/08/2021

Multiple Object Tracking with Correlation Learning

Recent works have shown that convolutional networks have substantially i...
10/12/2020

Locality Preserving Dense Graph Convolutional Networks with Graph Context-Aware Node Representations

Graph convolutional networks (GCNs) have been widely used for representa...
03/14/2021

Learning a Proposal Classifier for Multiple Object Tracking

The recent trend in multiple object tracking (MOT) is heading towards le...
03/16/2019

Fast Interactive Object Annotation with Curve-GCN

Manually labeling objects by tracing their boundaries is a laborious pro...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.