SBSS: Stacking-Based Semantic Segmentation Framework for Very High Resolution Remote Sensing Image

12/15/2022
by   Yuanzhi Cai, et al.
0

Semantic segmentation of Very High Resolution (VHR) remote sensing images is a fundamental task for many applications. However, large variations in the scales of objects in those VHR images pose a challenge for performing accurate semantic segmentation. Existing semantic segmentation networks are able to analyse an input image at up to four resizing scales, but this may be insufficient given the diversity of object scales. Therefore, Multi Scale (MS) test-time data augmentation is often used in practice to obtain more accurate segmentation results, which makes equal use of the segmentation results obtained at the different resizing scales. However, it was found in this study that different classes of objects had their preferred resizing scale for more accurate semantic segmentation. Based on this behaviour, a Stacking-Based Semantic Segmentation (SBSS) framework is proposed to improve the segmentation results by learning this behaviour, which contains a learnable Error Correction Module (ECM) for segmentation result fusion and an Error Correction Scheme (ECS) for computational complexity control. Two ECS, i.e., ECS-MS and ECS-SS, are proposed and investigated in this study. The Floating-point operations (Flops) required for ECS-MS and ECS-SS are similar to the commonly used MS test and the Single-Scale (SS) test, respectively. Extensive experiments on four datasets (i.e., Cityscapes, UAVid, LoveDA and Potsdam) show that SBSS is an effective and flexible framework. It achieved higher accuracy than MS when using ECS-MS, and similar accuracy as SS with a quarter of the memory footprint when using ECS-SS.

READ FULL TEXT

page 7

page 11

page 12

research
03/17/2020

An End-to-end Framework For Low-Resolution Remote Sensing Semantic Segmentation

High-resolution images for remote sensing applications are often not aff...
research
12/19/2019

SCAttNet: Semantic Segmentation Network with Spatial and Channel Attention Mechanism for High-Resolution Remote Sensing Images

High-resolution remote sensing images (HRRSIs) contain substantial groun...
research
08/26/2021

ChessMix: Spatial Context Data Augmentation for Remote Sensing Semantic Segmentation

Labeling semantic segmentation datasets is a costly and laborious proces...
research
05/22/2023

Hi-ResNet: A High-Resolution Remote Sensing Network for Semantic Segmentation

High-resolution remote sensing (HRS) semantic segmentation extracts key ...
research
07/06/2019

SAN: Scale-Aware Network for Semantic Segmentation of High-Resolution Aerial Images

High-resolution aerial images have a wide range of applications, such as...
research
11/24/2020

SegBlocks: Block-Based Dynamic Resolution Networks for Real-Time Segmentation

SegBlocks reduces the computational cost of existing neural networks, by...

Please sign up or login with your details

Forgot password? Click here to reset