Self-Supervised Equivariant Learning for Oriented Keypoint Detection

04/19/2022
by   Jongmin Lee, et al.
2

Detecting robust keypoints from an image is an integral part of many computer vision problems, and the characteristic orientation and scale of keypoints play an important role for keypoint description and matching. Existing learning-based methods for keypoint detection rely on standard translation-equivariant CNNs but often fail to detect reliable keypoints against geometric variations. To learn to detect robust oriented keypoints, we introduce a self-supervised learning framework using rotation-equivariant CNNs. We propose a dense orientation alignment loss by an image pair generated by synthetic transformations for training a histogram-based orientation map. Our method outperforms the previous methods on an image matching benchmark and a camera pose estimation benchmark.

READ FULL TEXT

page 1

page 5

page 8

page 15

page 16

page 17

page 18

research
06/15/2022

Self-Supervised Learning of Image Scale and Orientation

We study the problem of learning to assign a characteristic pose, i.e., ...
research
03/25/2023

Learning Rotation-Equivariant Features for Visual Correspondence

Extracting discriminative local features that are invariant to imaging v...
research
09/18/2023

RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy

Unlike in natural images, in endoscopy there is no clear notion of an up...
research
12/07/2019

Self-Supervised 3D Keypoint Learning for Ego-motion Estimation

Generating reliable illumination and viewpoint invariant keypoints is cr...
research
11/21/2022

Deep Projective Rotation Estimation through Relative Supervision

Orientation estimation is the core to a variety of vision and robotics t...
research
05/21/2022

AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints

Structured representations such as keypoints are widely used in pose tra...
research
02/01/2022

Sim2Real Object-Centric Keypoint Detection and Description

Keypoint detection and description play a central role in computer visio...

Please sign up or login with your details

Forgot password? Click here to reset