Contour Loss for Instance Segmentation via k-step Distance Transformation Image

02/22/2021
by   Xiaolong Guo, et al.
5

Instance segmentation aims to locate targets in the image and segment each target area at pixel level, which is one of the most important tasks in computer vision. Mask R-CNN is a classic method of instance segmentation, but we find that its predicted masks are unclear and inaccurate near contours. To cope with this problem, we draw on the idea of contour matching based on distance transformation image and propose a novel loss function, called contour loss. Contour loss is designed to specifically optimize the contour parts of the predicted masks, thus can assure more accurate instance segmentation. In order to make the proposed contour loss to be jointly trained under modern neural network frameworks, we design a differentiable k-step distance transformation image calculation module, which can approximately compute truncated distance transformation images of the predicted mask and corresponding ground-truth mask online. The proposed contour loss can be integrated into existing instance segmentation methods such as Mask R-CNN, and combined with their original loss functions without modification of the inference network structures, thus has strong versatility. Experimental results on COCO show that contour loss is effective, which can further improve instance segmentation performances.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 10

research
03/01/2019

Mask Scoring R-CNN

Letting a deep network be aware of the quality of its own predictions is...
research
09/19/2018

Faster Training of Mask R-CNN by Focusing on Instance Boundaries

We present an auxiliary task to Mask R-CNN, an instance segmentation net...
research
10/26/2020

GAN Mask R-CNN:Instance semantic segmentation benefits from generativeadversarial networks

In designing instance segmentation ConvNets that reconstruct masks, segm...
research
09/15/2021

UCP-Net: Unstructured Contour Points for Instance Segmentation

The goal of interactive segmentation is to assist users in producing seg...
research
07/11/2021

SE-PSNet: Silhouette-based Enhancement Feature for Panoptic Segmentation Network

Recently, there has been a panoptic segmentation task combining semantic...
research
11/30/2022

Growing Instance Mask on Leaf

Contour-based instance segmentation methods include one-stage and multi-...
research
06/26/2021

Descriptive Modeling of Textiles using FE Simulations and Deep Learning

In this work we propose a novel and fully automated method for extractin...

Please sign up or login with your details

Forgot password? Click here to reset