Visual Object Tracking by Segmentation with Graph Convolutional Network

by   Bo Jiang, et al.

Segmentation-based tracking has been actively studied in computer vision and multimedia. Superpixel based object segmentation and tracking methods are usually developed for this task. However, they independently perform feature representation and learning of superpixels which may lead to sub-optimal results. In this paper, we propose to utilize graph convolutional network (GCN) model for superpixel based object tracking. The proposed model provides a general end-to-end framework which integrates i) label linear prediction, and ii) structure-aware feature information of each superpixel together to obtain object segmentation and further improves the performance of tracking. The main benefits of the proposed GCN method have two main aspects. First, it provides an effective end-to-end way to exploit both spatial and temporal consistency constraint for target object segmentation. Second, it utilizes a mixed graph convolution module to learn a context-aware and discriminative feature for superpixel representation and labeling. An effective algorithm has been developed to optimize the proposed model. Extensive experiments on five datasets demonstrate that our method obtains better performance against existing alternative methods.



There are no comments yet.


page 1

page 6


PH-GCN: Person Re-identification with Part-based Hierarchical Graph Convolutional Network

The person re-identification (Re-ID) task requires to robustly extract f...

Learning Aligned-Spatial Graph Convolutional Networks for Graph Classification

In this paper, we develop a novel Aligned-Spatial Graph Convolutional Ne...

GCNNMatch: Graph Convolutional Neural Networks for Multi-Object Tracking via Sinkhorn Normalization

This paper proposes a novel method for online Multi-Object Tracking (MOT...

Multiple Object Tracking with Correlation Learning

Recent works have shown that convolutional networks have substantially i...

Locality Preserving Dense Graph Convolutional Networks with Graph Context-Aware Node Representations

Graph convolutional networks (GCNs) have been widely used for representa...

Learning a Proposal Classifier for Multiple Object Tracking

The recent trend in multiple object tracking (MOT) is heading towards le...

Fast Interactive Object Annotation with Curve-GCN

Manually labeling objects by tracing their boundaries is a laborious pro...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.