Semantic Attention and Scale Complementary Network for Instance Segmentation in Remote Sensing Images

07/25/2021
by   Tianyang Zhang, et al.
14

In this paper, we focus on the challenging multicategory instance segmentation problem in remote sensing images (RSIs), which aims at predicting the categories of all instances and localizing them with pixel-level masks. Although many landmark frameworks have demonstrated promising performance in instance segmentation, the complexity in the background and scale variability instances still remain challenging for instance segmentation of RSIs. To address the above problems, we propose an end-to-end multi-category instance segmentation model, namely Semantic Attention and Scale Complementary Network, which mainly consists of a Semantic Attention (SEA) module and a Scale Complementary Mask Branch (SCMB). The SEA module contains a simple fully convolutional semantic segmentation branch with extra supervision to strengthen the activation of interest instances on the feature map and reduce the background noise's interference. To handle the under-segmentation of geospatial instances with large varying scales, we design the SCMB that extends the original single mask branch to trident mask branches and introduces complementary mask supervision at different scales to sufficiently leverage the multi-scale information. We conduct comprehensive experiments to evaluate the effectiveness of our proposed method on the iSAID dataset and the NWPU Instance Segmentation dataset and achieve promising performance.

READ FULL TEXT

page 1

page 4

page 7

page 8

page 10

page 11

page 12

research
09/06/2018

Panoptic Segmentation with a Joint Semantic and Instance Segmentation Network

We present an end-to-end method for the task of panoptic segmentation. T...
research
04/22/2019

Ship Instance Segmentation From Remote Sensing Images Using Sequence Local Context Module

The performance of object instance segmentation in remote sensing images...
research
03/23/2020

EPSNet: Efficient Panoptic Segmentation Network with Cross-layer Attention Fusion

Panoptic segmentation is a scene parsing task which unifies semantic seg...
research
09/07/2022

SUNet: Scale-aware Unified Network for Panoptic Segmentation

Panoptic segmentation combines the advantages of semantic and instance s...
research
02/15/2020

Cell R-CNN V3: A Novel Panoptic Paradigm for Instance Segmentation in Biomedical Images

Instance segmentation is an important task for biomedical image analysis...
research
08/12/2022

Semantic decomposition Network with Contrastive and Structural Constraints for Dental Plaque Segmentation

Segmenting dental plaque from images of medical reagent staining provide...
research
07/12/2016

Gland Instance Segmentation by Deep Multichannel Side Supervision

In this paper, we propose a new image instance segmentation method that ...

Please sign up or login with your details

Forgot password? Click here to reset