Looking for change? Roll the Dice and demand Attention

09/04/2020
by   Foivos I. Diakogiannis, et al.
20

Change detection, i.e. identification per pixel of changes for some classes of interest from a set of bi-temporal co-registered images, is a fundamental task in the field of remote sensing. It remains challenging due to unrelated forms of change that appear at different times in input images. These are changes due to to different environmental conditions or simply changes of objects that are not of interest. Here, we propose a reliable deep learning framework for the task of semantic change detection in very high-resolution aerial images. Our framework consists of a new loss function, new attention modules, new feature extraction building blocks, and a new backbone architecture that is tailored for the task of semantic change detection. Specifically, we define a new form of set similarity, that is based on an iterative evaluation of a variant of the Dice coefficient. We use this similarity metric to define a new loss function as well as a new spatial and channel convolution Attention layer (the FracTAL). The new attention layer, designed specifically for vision tasks, is memory efficient, thus suitable for use in all levels of deep convolutional networks. Based on these, we introduce two new efficient self-contained feature extraction convolution units. We term these units CEECNet and FracTAL ResNet units. We validate the performance of these feature extraction building blocks on the CIFAR10 reference data and compare the results with standard ResNet modules. Further, we introduce a new encoder/decoder scheme, a network macro-topology, that is tailored for the task of change detection. We validate our approach by showing excellent performance and achieving state of the art score (F1 and Intersection over Union - hereafter IoU) on two building change detection datasets, namely, the LEVIRCD (F1: 0.918, IoU: 0.848) and the WHU (F1: 0.938, IoU: 0.882) datasets.

READ FULL TEXT

Authors

page 2

page 4

page 11

page 12

page 17

page 18

page 19

page 22

04/01/2019

ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data

Scene understanding of high resolution aerial images is of great importa...
09/17/2019

Building Change Detection for Remote Sensing Images Using a Dual Task Constrained Deep Siamese Convolutional Network Model

In recent years, building change detection methods have made great progr...
03/01/2021

DR-TANet: Dynamic Receptive Temporal Attention Network for Street Scene Change Detection

Street scene change detection continues to capture researchers' interest...
09/10/2021

Unsupervised Change Detection in Hyperspectral Images using Feature Fusion Deep Convolutional Autoencoders

Binary change detection in bi-temporal co-registered hyperspectral image...
03/07/2020

Semantic Change Pattern Analysis

Change detection is an important problem in vision field, especially for...
10/17/2019

Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Data

The advent of multitemporal high resolution data, like the Copernicus S...

Code Repositories

ceecnet

source code for the task of semantic change detection (built with mxnet)


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.