Align, Perturb and Decouple: Toward Better Leverage of Difference Information for RSI Change Detection

05/30/2023
by   Supeng Wang, et al.
0

Change detection is a widely adopted technique in remote sense imagery (RSI) analysis in the discovery of long-term geomorphic evolution. To highlight the areas of semantic changes, previous effort mostly pays attention to learning representative feature descriptors of a single image, while the difference information is either modeled with simple difference operations or implicitly embedded via feature interactions. Nevertheless, such difference modeling can be noisy since it suffers from non-semantic changes and lacks explicit guidance from image content or context. In this paper, we revisit the importance of feature difference for change detection in RSI, and propose a series of operations to fully exploit the difference information: Alignment, Perturbation and Decoupling (APD). Firstly, alignment leverages contextual similarity to compensate for the non-semantic difference in feature space. Next, a difference module trained with semantic-wise perturbation is adopted to learn more generalized change estimators, which reversely bootstraps feature extraction and prediction. Finally, a decoupled dual-decoder structure is designed to predict semantic changes in both content-aware and content-agnostic manners. Extensive experiments are conducted on benchmarks of LEVIR-CD, WHU-CD and DSIFN-CD, demonstrating our proposed operations bring significant improvement and achieve competitive results under similar comparative conditions. Code is available at https://github.com/wangsp1999/CD-Research/tree/main/openAPD

READ FULL TEXT

page 1

page 3

page 6

page 7

research
12/20/2022

Self-Pair: Synthesizing Changes from Single Source for Object Change Detection in Remote Sensing Imagery

For change detection in remote sensing, constructing a training dataset ...
research
10/22/2018

Learning to Measure Change: Fully Convolutional Siamese Metric Networks for Scene Change Detection

The key factor of scene change detection is to learn effective feature t...
research
04/03/2023

Dsfer-Net: A Deep Supervision and Feature Retrieval Network for Bitemporal Change Detection Using Modern Hopfield Networks

Change detection, as an important application for high-resolution remote...
research
03/07/2020

DASNet: Dual attentive fully convolutional siamese networks for change detection of high resolution satellite images

Change detection is a basic task of remote sensing image processing. The...
research
03/06/2023

Neighborhood Contrastive Transformer for Change Captioning

Change captioning is to describe the semantic change between a pair of s...
research
08/21/2022

Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentation

In this work, we revisit the weak-to-strong consistency framework, popul...

Please sign up or login with your details

Forgot password? Click here to reset