RIFT: Multi-modal Image Matching Based on Radiation-invariant Feature Transform

04/25/2018
by   Jiayuan Li, et al.
0

Traditional feature matching methods such as scale-invariant feature transform (SIFT) usually use image intensity or gradient information to detect and describe feature points; however, both intensity and gradient are sensitive to nonlinear radiation distortions (NRD). To solve the problem, this paper proposes a novel feature matching algorithm that is robust to large NRD. The proposed method is called radiation-invariant feature transform (RIFT). There are three main contributions in RIFT: first, RIFT uses phase congruency (PC) instead of image intensity for feature point detection. RIFT considers both the number and repeatability of feature points, and detects both corner points and edge points on the PC map. Second, RIFT originally proposes a maximum index map (MIM) for feature description. MIM is constructed from the log-Gabor convolution sequence and is much more robust to NRD than traditional gradient map. Thus, RIFT not only largely improves the stability of feature detection, but also overcomes the limitation of gradient information for feature description. Third, RIFT analyzes the inherent influence of rotations on the values of MIM, and realizes rotation invariance. We use six different types of multi-model image datasets to evaluate RIFT, including optical-optical, infrared-optical, synthetic aperture radar (SAR)-optical, depth-optical, map-optical, and day-night datasets. Experimental results show that RIFT is much more superior to SIFT and SAR-SIFT. To the best of our knowledge, RIFT is the first feature matching algorithm that can achieve good performance on all the above-mentioned types of multi-model images. The source code of RIFT and multi-modal remote sensing image datasets are made public .

READ FULL TEXT

page 5

page 6

page 7

page 8

page 10

page 11

page 13

research
06/01/2023

Multi-Modal Deep Learning for Multi-Temporal Urban Mapping With a Partly Missing Optical Modality

This paper proposes a novel multi-temporal urban mapping approach using ...
research
08/19/2018

A Fast and Robust Matching Framework for Multimodal Remote Sensing Image Registration

While image registration has been studied in remote sensing community fo...
research
12/05/2022

R2FD2: Fast and Robust Matching of Multimodal Remote Sensing Image via Repeatable Feature Detector and Rotation-invariant Feature Descriptor

Automatically identifying feature correspondences between multimodal ima...
research
11/17/2021

Nonlinear Intensity Sonar Image Matching based on Deep Convolution Features

In the field of deep-sea exploration, sonar is presently the only effici...
research
09/05/2016

Depth Reconstruction and Computer-Aided Polyp Detection in Optical Colonoscopy Video Frames

We present a computer-aided detection algorithm for polyps in optical co...
research
09/11/2018

Intensity and Rescale Invariant Copy Move Forgery Detection Techniques

In this contemporary world digital media such as videos and images behav...
research
10/07/2017

Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Images

Fast and robust image matching is a very important task with various app...

Please sign up or login with your details

Forgot password? Click here to reset