A Fast and Robust Matching Framework for Multimodal Remote Sensing Image Registration

by   Yuanxin Ye, et al.

While image registration has been studied in remote sensing community for decades, registering multimodal data [e.g., optical, light detection and ranging (LiDAR), synthetic aperture radar (SAR), and map] remains a challenging problem because of significant nonlinear intensity differences between such data. To address this problem, we present a novel fast and robust matching framework integrating local descriptors for multimodal registration. In the proposed framework, a local descriptor (such as Histogram of Oriented Gradient (HOG), Local Self-Similarity or Speeded-Up Robust Feature) is first extracted at each pixel to form a pixel-wise feature representation of an image. Then we define a similarity measure based on the feature representation in frequency domain using the Fast Fourier Transform (FFT) technique, followed by a template matching scheme to detect control points between images. We also propose a novel pixel-wise feature representation using orientated gradients of images, which is named channel features of orientated gradients (CFOG). This novel feature is an extension of the pixel-wise HOG descriptor, and outperforms that both in matching performance and computational efficiency. The major advantages of the proposed framework include (1) structural similarity representation using the pixel-wise feature description and (2) high computational efficiency due to the use of FFT. Moreover, we design an automatic registration system for very large-size multimodal images based on the proposed framework. Experimental results obtained on many different types of multimodal images show the superior matching performance of the proposed framework with respect to the state-of-the-art methods and the effectiveness of the designed system, which show very good potential large-size image registration in real applications.



There are no comments yet.


page 3

page 10

page 12

page 15

page 17

page 21

page 27

page 29


Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity

Automatic registration of multimodal remote sensing data (e.g., optical,...

A Robust Multimodal Remote Sensing Image Registration Method and System Using Steerable Filters with First- and Second-order Gradients

Co-registration of multimodal remote sensing images is still an ongoing ...

RIFT: Multi-modal Image Matching Based on Radiation-invariant Feature Transform

Traditional feature matching methods such as scale-invariant feature tra...

RFVTM: A Recovery and Filtering Vertex Trichotomy Matching for Remote Sensing Image Registration

Reliable feature point matching is a vital yet challenging process in fe...

A Fast and Accurate Nonlinear Spectral Method for Image Recognition and Registration

This article addresses the problem of two- and higher dimensional patter...

An Effective Image Feature Classiffication using an improved SOM

Image feature classification is a challenging problem in many computer v...

gprHOG: Several Simple Improvements to the Histogram of Oriented Gradients Feature for Threat Detection in Ground-Penetrating Radar

The ground penetrating radar (GPR) is one of the most successful remote ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.