Hyperspectral Image Classification with Spatial Consistence Using Fully Convolutional Spatial Propagation Network

08/04/2020
by   Yenan Jiang, et al.
0

In recent years, deep convolutional neural networks (CNNs) have shown impressive ability to represent hyperspectral images (HSIs) and achieved encouraging results in HSI classification. However, the existing CNN-based models operate at the patch-level, in which pixel is separately classified into classes using a patch of images around it. This patch-level classification will lead to a large number of repeated calculations, and it is difficult to determine the appropriate patch size that is beneficial to classification accuracy. In addition, the conventional CNN models operate convolutions with local receptive fields, which cause failures in modeling contextual spatial information. To overcome the aforementioned limitations, we propose a novel end-to-end, pixels-to-pixels fully convolutional spatial propagation network (FCSPN) for HSI classification. Our FCSPN consists of a 3D fully convolution network (3D-FCN) and a convolutional spatial propagation network (CSPN). Specifically, the 3D-FCN is firstly introduced for reliable preliminary classification, in which a novel dual separable residual (DSR) unit is proposed to effectively capture spectral and spatial information simultaneously with fewer parameters. Moreover, the channel-wise attention mechanism is adapted in the 3D-FCN to grasp the most informative channels from redundant channel information. Finally, the CSPN is introduced to capture the spatial correlations of HSI via learning a local linear spatial propagation, which allows maintaining the HSI spatial consistency and further refining the classification results. Experimental results on three HSI benchmark datasets demonstrate that the proposed FCSPN achieves state-of-the-art performance on HSI classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 9

page 10

page 11

page 12

04/16/2019

Deep Neural Network Based Hyperspectral Pixel Classification With Factorized Spectral-Spatial Feature Representation

Deep learning has been widely used for hyperspectral pixel classificatio...
03/18/2021

TPPI-Net: Towards Efficient and Practical Hyperspectral Image Classification

Hyperspectral Image(HSI) classification is the most vibrant field of res...
11/11/2020

FPGA: Fast Patch-Free Global Learning Framework for Fully End-to-End Hyperspectral Image Classification

Deep learning techniques have provided significant improvements in hyper...
01/19/2018

A Foreground Inference Network for Video Surveillance Using Multi-View Receptive Field

Foreground (FG) pixel labelling plays a vital role in video surveillance...
07/28/2021

Content-aware Directed Propagation Network with Pixel Adaptive Kernel Attention

Convolutional neural networks (CNNs) have been not only widespread but a...
12/15/2014

Highly Efficient Forward and Backward Propagation of Convolutional Neural Networks for Pixelwise Classification

We present highly efficient algorithms for performing forward and backwa...
03/01/2016

Cascaded Subpatch Networks for Effective CNNs

Conventional Convolutional Neural Networks (CNNs) use either a linear or...