D2D: Learning to find good correspondences for image matching and manipulation

07/16/2020
by   Olivia Wiles, et al.
10

We propose a new approach to determining correspondences between image pairs under large changes in illumination, viewpoint, context, and material. While most approaches seek to extract a set of reliably detectable regions in each image which are then compared (sparse-to-sparse) using increasingly complicated or specialized pipelines, we propose a simple approach for matching all points between the images (dense-to-dense) and subsequently selecting the best matches. The two key parts of our approach are: (i) to condition the learned features on both images, and (ii) to learn a distinctiveness score which is used to choose the best matches at test time. We demonstrate that our model can be used to achieve state of the art or competitive results on a wide range of tasks: local matching, camera localization, 3D reconstruction, and image stylization.

READ FULL TEXT

page 1

page 6

page 8

page 15

page 16

page 17

page 18

page 19

research
06/24/2014

Dense Correspondences Across Scenes and Scales

We seek a practical method for establishing dense correspondences betwee...
research
02/01/2022

Deep Kernelized Dense Geometric Matching

Dense geometric matching is a challenging computer vision task, requirin...
research
07/09/2019

Sparse-to-Dense Hypercolumn Matching for Long-Term Visual Localization

We propose a novel approach to feature point matching, suitable for robu...
research
10/21/2020

Learning to Guide Local Feature Matches

We tackle the problem of finding accurate and robust keypoint correspond...
research
07/04/2020

Self-Calibration Supported Robust Projective Structure-from-Motion

Typical Structure-from-Motion (SfM) pipelines rely on finding correspond...
research
04/07/2021

Warp Consistency for Unsupervised Learning of Dense Correspondences

The key challenge in learning dense correspondences lies in the lack of ...
research
12/06/2016

Cluster-Wise Ratio Tests for Fast Camera Localization

Feature point matching for camera localization suffers from scalability ...

Please sign up or login with your details

Forgot password? Click here to reset