Boundary-preserving Mask R-CNN

07/17/2020
by   Tianheng Cheng, et al.
23

Tremendous efforts have been made to improve mask localization accuracy in instance segmentation. Modern instance segmentation methods relying on fully convolutional networks perform pixel-wise classification, which ignores object boundaries and shapes, leading coarse and indistinct mask prediction results and imprecise localization. To remedy these problems, we propose a conceptually simple yet effective Boundary-preserving Mask R-CNN (BMask R-CNN) to leverage object boundary information to improve mask localization accuracy. BMask R-CNN contains a boundary-preserving mask head in which object boundary and mask are mutually learned via feature fusion blocks. As a result, the predicted masks are better aligned with object boundaries. Without bells and whistles, BMask R-CNN outperforms Mask R-CNN by a considerable margin on the COCO dataset; in the Cityscapes dataset, there are more accurate boundary groundtruths available, so that BMask R-CNN obtains remarkable improvements over Mask R-CNN. Besides, it is not surprising to observe that BMask R-CNN obtains more obvious improvement when the evaluation criterion requires better localization (e.g., AP_75) as shown in Fig.1. Code and models are available at <https://github.com/hustvl/BMaskR-CNN>.

READ FULL TEXT

page 2

page 12

page 14

research
03/01/2019

Mask Scoring R-CNN

Letting a deep network be aware of the quality of its own predictions is...
research
04/12/2021

Look Closer to Segment Better: Boundary Patch Refinement for Instance Segmentation

Tremendous efforts have been made on instance segmentation but the mask ...
research
07/23/2020

Regularization of Building Boundaries in Satellite Images using Adversarial and Regularized Losses

In this paper we present a method for building boundary refinement and r...
research
09/19/2018

Faster Training of Mask R-CNN by Focusing on Instance Boundaries

We present an auxiliary task to Mask R-CNN, an instance segmentation net...
research
10/26/2020

GAN Mask R-CNN:Instance semantic segmentation benefits from generativeadversarial networks

In designing instance segmentation ConvNets that reconstruct masks, segm...
research
10/12/2022

AISFormer: Amodal Instance Segmentation with Transformer

Amodal Instance Segmentation (AIS) aims to segment the region of both vi...
research
07/05/2021

Are standard Object Segmentation models sufficient for Learning Affordance Segmentation?

Affordances are the possibilities of actions the environment offers to t...

Please sign up or login with your details

Forgot password? Click here to reset