IF-Net: An Illumination-invariant Feature Network

08/10/2020
by   Po-Heng Chen, et al.
0

Feature descriptor matching is a critical step is many computer vision applications such as image stitching, image retrieval and visual localization. However, it is often affected by many practical factors which will degrade its performance. Among these factors, illumination variations are the most influential one, and especially no previous descriptor learning works focus on dealing with this problem. In this paper, we propose IF-Net, aimed to generate a robust and generic descriptor under crucial illumination changes conditions. We find out not only the kind of training data important but also the order it is presented. To this end, we investigate several dataset scheduling methods and propose a separation training scheme to improve the matching accuracy. Further, we propose a ROI loss and hard-positive mining strategy along with the training scheme, which can strengthen the ability of generated descriptor dealing with large illumination change conditions. We evaluate our approach on public patch matching benchmark and achieve the best results compared with several state-of-the-arts methods. To show the practicality, we further evaluate IF-Net on the task of visual localization under large illumination changes scenes, and achieves the best localization accuracy.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
05/13/2023

Illumination-insensitive Binary Descriptor for Visual Measurement Based on Local Inter-patch Invariance

Binary feature descriptors have been widely used in various visual measu...
research
09/09/2017

How to Train a CAT: Learning Canonical Appearance Transformations for Direct Visual Localization Under Illumination Change

Direct visual localization has recently enjoyed a resurgence in populari...
research
02/06/2021

Sill-Net: Feature Augmentation with Separated Illumination Representation

For visual object recognition tasks, the illumination variations can cau...
research
01/25/2023

Local Feature Extraction from Salient Regions by Feature Map Transformation

Local feature matching is essential for many applications, such as local...
research
01/16/2013

Regularized Discriminant Embedding for Visual Descriptor Learning

Images can vary according to changes in viewpoint, resolution, noise, an...
research
10/03/2018

Performance Evaluation of SIFT Descriptor against Common Image Deformations on Iban Plaited Mat Motifs

Borneo indigenous communities are blessed with rich craft heritage. One ...
research
09/16/2020

Domain-invariant Similarity Activation Map Metric Learning for Retrieval-based Long-term Visual Localization

Visual localization is a crucial component in the application of mobile ...

Please sign up or login with your details

Forgot password? Click here to reset