FisheyeSuperPoint: Keypoint Detection and Description Network for Fisheye Images

02/27/2021
by   Anna Konrad, et al.
0

Keypoint detection and description is a commonly used building block in computer vision systems particularly for robotics and autonomous driving. Recently CNN based approaches have surpassed classical methods in a number of perception tasks. However, the majority of techniques to date have focused on standard cameras with little consideration given to fisheye cameras which are commonly used in autonomous driving. In this paper, we propose a novel training and evaluation pipeline for fisheye images. We make use of SuperPoint as our baseline which is a self-supervised keypoint detector and descriptor that has achieved state-of-the-art results on homography estimation. We introduce a fisheye adaptation pipeline to enable training on undistorted fisheye images. We evaluate the performance on the HPatches benchmark, and, by introducing a fisheye based evaluation methods for detection repeatability and descriptor matching correctness on the Oxford RobotCar datasets.

READ FULL TEXT

page 2

page 5

research
12/23/2019

Neural Outlier Rejection for Self-Supervised Keypoint Learning

Identifying salient points in images is a crucial component for visual o...
research
06/14/2019

R2D2: Repeatable and Reliable Detector and Descriptor

Interest point detection and local feature description are fundamental s...
research
06/09/2020

SEKD: Self-Evolving Keypoint Detection and Description

Researchers have attempted utilizing deep neural network (DNN) to learn ...
research
10/07/2021

Using Keypoint Matching and Interactive Self Attention Network to verify Retail POSMs

Point of Sale Materials(POSM) are the merchandising and decoration items...
research
09/26/2018

CNN-based Pore Detection and Description for High-Resolution Fingerprint Recognition

High-resolution fingerprint recognition usually relies on sophisticated ...
research
11/04/2020

Realtime CNN-based Keypoint Detector with Sobel Filter and CNN-based Descriptor Trained with Keypoint Candidates

The local feature detector and descriptor are essential in many computer...
research
02/22/2018

End-to-end learning of keypoint detector and descriptor for pose invariant 3D matching

Finding correspondences between images or 3D scans is at the heart of ma...

Please sign up or login with your details

Forgot password? Click here to reset