RIFT2: Speeding-up RIFT with A New Rotation-Invariance Technique

03/01/2023
by   Jiayuan Li, et al.
0

Multimodal image matching is an important prerequisite for multisource image information fusion. Compared with the traditional matching problem, multimodal feature matching is more challenging due to the severe nonlinear radiation distortion (NRD). Radiation-variation insensitive feature transform (RIFT) <cit.> has shown very good robustness to NRD and become a baseline method in multimodal feature matching. However, the high computational cost for rotation invariance largely limits its usage in practice. In this paper, we propose an improved RIFT method, called RIFT2. We develop a new rotation invariance technique based on dominant index value, which avoids the construction process of convolution sequence ring. Hence, it can speed up the running time and reduce the memory consumption of the original RIFT by almost 3 times in theory. Extensive experiments show that RIFT2 achieves similar matching performance to RIFT while being much faster and having less memory consumption. The source code will be made publicly available in <https://github.com/LJY-RS/RIFT2-multimodal-matching-rotation>

READ FULL TEXT

page 1

page 3

page 4

research
02/28/2023

Nonlinear Intensity, Scale and Rotation Invariant Matching for Multimodal Images

We present an effective method for the matching of multimodal images. Ac...
research
12/05/2022

R2FD2: Fast and Robust Matching of Multimodal Remote Sensing Image via Repeatable Feature Detector and Rotation-invariant Feature Descriptor

Automatically identifying feature correspondences between multimodal ima...
research
05/10/2021

VDB-EDT: An Efficient Euclidean Distance Transform Algorithm Based on VDB Data Structure

This paper presents a fundamental algorithm, called VDB-EDT, for Euclide...
research
09/22/2022

DRKF: Distilled Rotated Kernel Fusion for Efficiently Boosting Rotation Invariance in Image Matching

Most existing learning-based image matching pipelines are designed for b...
research
02/02/2023

MMRec: Simplifying Multimodal Recommendation

This paper presents an open-source toolbox, MMRec for multimodal recomme...
research
05/17/2023

Towards Multi-Layered 3D Garments Animation

Mimicking realistic dynamics in 3D garment animations is a challenging t...
research
05/18/2022

Deep learning on rail profiles matching

Matching the rail cross-section profiles measured on site with the desig...

Please sign up or login with your details

Forgot password? Click here to reset