Fast Interactive Object Annotation with Curve-GCN

by   Huan Ling, et al.

Manually labeling objects by tracing their boundaries is a laborious process. In Polygon-RNN++ the authors proposed Polygon-RNN that produces polygonal annotations in a recurrent manner using a CNN-RNN architecture, allowing interactive correction via humans-in-the-loop. We propose a new framework that alleviates the sequential nature of Polygon-RNN, by predicting all vertices simultaneously using a Graph Convolutional Network (GCN). Our model is trained end-to-end. It supports object annotation by either polygons or splines, facilitating labeling efficiency for both line-based and curved objects. We show that Curve-GCN outperforms all existing approaches in automatic mode, including the powerful PSP-DeepLab and is significantly more efficient in interactive mode than Polygon-RNN++. Our model runs at 29.3ms in automatic, and 2.6ms in interactive mode, making it 10x and 100x faster than Polygon-RNN++.



page 1

page 3

page 7

page 8


Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++

Manually labeling datasets with object masks is extremely time consuming...

Split GCN: Effective Interactive Annotation for Segmentation of Disconnected Instance

Annotating object boundaries by humans demands high costs. Recently, pol...

OD-GCN object detection by knowledge graph with GCN

Classical object detection frameworks lack of utilizing objects' surroun...

MER-GCN: Micro Expression Recognition Based on Relation Modeling with Graph Convolutional Network

Micro-Expression (ME) is the spontaneous, involuntary movement of a face...

Relation Modeling with Graph Convolutional Networks for Facial Action Unit Detection

Most existing AU detection works considering AU relationships are relyin...

Visual Object Tracking by Segmentation with Graph Convolutional Network

Segmentation-based tracking has been actively studied in computer vision...

A Graph-based Interactive Reasoning for Human-Object Interaction Detection

Human-Object Interaction (HOI) detection devotes to learn how humans int...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.