Deep Snake for Real-Time Instance Segmentation

01/06/2020
by   Sida Peng, et al.
18

This paper introduces a novel contour-based approach named deep snake for real-time instance segmentation. Unlike some recent methods that directly regress the coordinates of the object boundary points from an image, deep snake uses a neural network to iteratively deform an initial contour to the object boundary, which implements the classic idea of snake algorithms with a learning-based approach. For structured feature learning on the contour, we propose to use circular convolution in deep snake, which better exploits the cycle-graph structure of a contour compared against generic graph convolution. Based on deep snake, we develop a two-stage pipeline for instance segmentation: initial contour proposal and contour deformation, which can handle errors in initial object localization. Experiments show that the proposed approach achieves state-of-the-art performances on the Cityscapes, Kins and Sbd datasets while being efficient for real-time instance segmentation, 32.3 fps for 512×512 images on a 1080Ti GPU. The code will be available at https://github.com/zju3dv/snake/.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 8

page 9

research
01/21/2023

Recurrent Contour-based Instance Segmentation with Progressive Learning

Contour-based instance segmentation has been actively studied, thanks to...
research
08/24/2022

Applying Eigencontours to PolarMask-Based Instance Segmentation

Eigencontours are the first data-driven contour descriptors based on sin...
research
03/24/2022

SharpContour: A Contour-based Boundary Refinement Approach for Efficient and Accurate Instance Segmentation

Excellent performance has been achieved on instance segmentation but the...
research
12/25/2019

Neural ODEs for Image Segmentation with Level Sets

We propose a novel approach for image segmentation that combines Neural ...
research
11/02/2022

CircleSnake: Instance Segmentation with Circle Representation

Circle representation has recently been introduced as a medical imaging ...
research
04/07/2021

Contour Proposal Networks for Biomedical Instance Segmentation

We present a conceptually simple framework for object instance segmentat...
research
06/07/2021

ContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Pass

Direct contour regression for instance segmentation is a challenging tas...

Please sign up or login with your details

Forgot password? Click here to reset