RSI-Net: Two-Stream Deep Neural Network Integrating GCN and Atrous CNN for Semantic Segmentation of High-resolution Remote Sensing Images

by   Shuang He, et al.

For semantic segmentation of remote sensing images (RSI), trade-off between representation power and location accuracy is quite important. How to get the trade-off effectively is an open question, where current approaches of utilizing attention schemes or very deep models result in complex models with large memory consumption. Compared with the popularly-used convolutional neural network (CNN) with fixed square kernels, graph convolutional network (GCN) can explicitly utilize correlations between adjacent land covers and conduct flexible convolution on arbitrarily irregular image regions. However, the problems of large variations of target scales and blurred boundary cannot be easily solved by GCN, while densely connected atrous convolution network (DenseAtrousCNet) with multi-scale atrous convolution can expand the receptive fields and obtain image global information. Inspired by the advantages of both GCN and Atrous CNN, a two-stream deep neural network for semantic segmentation of RSI (RSI-Net) is proposed in this paper to obtain improved performance through modeling and propagating spatial contextual structure effectively and a novel decoding scheme with image-level and graph-level combination. Extensive experiments are implemented on the Vaihingen, Potsdam and Gaofen RSI datasets, where the comparison results demonstrate the superior performance of RSI-Net in terms of overall accuracy, F1 score and kappa coefficient when compared with six state-of-the-art RSI semantic segmentation methods.


page 5

page 8

page 9

page 11

page 12

page 13

page 14


MACU-Net Semantic Segmentation from High-Resolution Remote Sensing Images

Semantic segmentation of remote sensing images plays an important role i...

A novel Deep Structure U-Net for Sea-Land Segmentation in Remote Sensing Images

Sea-land segmentation is an important process for many key applications ...

ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Images

Semantic segmentation of remotely sensed images plays a crucial role in ...

Dense Dilated Convolutions Merging Network for Semantic Mapping of Remote Sensing Images

We propose a network for semantic mapping called the Dense Dilated Convo...

CEU-Net: Ensemble Semantic Segmentation of Hyperspectral Images Using Clustering

Most semantic segmentation approaches of Hyperspectral images (HSIs) use...

Please sign up or login with your details

Forgot password? Click here to reset