Decoupling Makes Weakly Supervised Local Feature Better

01/08/2022
by   Kunhong Li, et al.
20

Weakly supervised learning can help local feature methods to overcome the obstacle of acquiring a large-scale dataset with densely labeled correspondences. However, since weak supervision cannot distinguish the losses caused by the detection and description steps, directly conducting weakly supervised learning within a joint describe-then-detect pipeline suffers limited performance. In this paper, we propose a decoupled describe-then-detect pipeline tailored for weakly supervised local feature learning. Within our pipeline, the detection step is decoupled from the description step and postponed until discriminative and robust descriptors are learned. In addition, we introduce a line-to-window search strategy to explicitly use the camera pose information for better descriptor learning. Extensive experiments show that our method, namely PoSFeat (Camera Pose Supervised Feature), outperforms previous fully and weakly supervised methods and achieves state-of-the-art performance on a wide range of downstream tasks.

READ FULL TEXT

page 1

page 3

page 4

page 6

research
12/13/2022

Losses over Labels: Weakly Supervised Learning via Direct Loss Construction

Owing to the prohibitive costs of generating large amounts of labeled da...
research
12/14/2022

Shared Coupling-bridge for Weakly Supervised Local Feature Learning

Sparse local feature extraction is usually believed to be of important s...
research
02/14/2022

Tightly Coupled Learning Strategy for Weakly Supervised Hierarchical Place Recognition

Visual place recognition (VPR) is a key issue for robotics and autonomou...
research
08/04/2018

Learning to Align Images using Weak Geometric Supervision

Image alignment tasks require accurate pixel correspondences, which are ...
research
01/15/2023

What's happening in your neighborhood? A Weakly Supervised Approach to Detect Local News

Local news articles are a subset of news that impact users in a geograph...
research
09/15/2023

Unified Risk Analysis for Weakly Supervised Learning

Among the flourishing research of weakly supervised learning (WSL), we r...
research
06/20/2021

Tag, Copy or Predict: A Unified Weakly-Supervised Learning Framework for Visual Information Extraction using Sequences

Visual information extraction (VIE) has attracted increasing attention i...

Please sign up or login with your details

Forgot password? Click here to reset