Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

03/31/2021
by   Yuanxin Ye, et al.
0

Automatic registration of multimodal remote sensing data (e.g., optical, LiDAR, SAR) is a challenging task due to the significant non-linear radiometric differences between these data. To address this problem, this paper proposes a novel feature descriptor named the Histogram of Orientated Phase Congruency (HOPC), which is based on the structural properties of images. Furthermore, a similarity metric named HOPCncc is defined, which uses the normalized correlation coefficient (NCC) of the HOPC descriptors for multimodal registration. In the definition of the proposed similarity metric, we first extend the phase congruency model to generate its orientation representation, and use the extended model to build HOPCncc. Then a fast template matching scheme for this metric is designed to detect the control points between images. The proposed HOPCncc aims to capture the structural similarity between images, and has been tested with a variety of optical, LiDAR, SAR and map data. The results show that HOPCncc is robust against complex non-linear radiometric differences and outperforms the state-of-the-art similarities metrics (i.e., NCC and mutual information) in matching performance. Moreover, a robust registration method is also proposed in this paper based on HOPCncc, which is evaluated using six pairs of multimodal remote sensing images. The experimental results demonstrate the effectiveness of the proposed method for multimodal image registration.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 9

page 12

page 13

page 15

research
08/19/2018

A Fast and Robust Matching Framework for Multimodal Remote Sensing Image Registration

While image registration has been studied in remote sensing community fo...
research
04/01/2022

MS-HLMO: Multi-scale Histogram of Local Main Orientation for Remote Sensing Image Registration

Multi-source image registration is challenging due to intensity, rotatio...
research
04/21/2020

Fast and Robust Registration of Aerial Images and LiDAR data Based on Structrual Features and 3D Phase Correlation

Co-Registration of aerial imagery and Light Detection and Ranging (LiDAR...
research
05/22/2020

Misregistration Measurement and Improvement for Sentinel-1 SAR and Sentinel-2 Optical images

Co-registering the Sentinel-1 SAR and Sentinel-2 optical data of Europea...
research
06/09/2021

PCNet: A Structure Similarity Enhancement Method for Multispectral and Multimodal Image Registration

Multispectral and multimodal image processing is important in the commun...
research
04/02/2022

RFVTM: A Recovery and Filtering Vertex Trichotomy Matching for Remote Sensing Image Registration

Reliable feature point matching is a vital yet challenging process in fe...
research
10/03/2022

Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

Unsupervised multimodal change detection is a practical and challenging ...

Please sign up or login with your details

Forgot password? Click here to reset