Convolutional Hough Matching Networks

03/31/2021
by   Juhong Min, et al.
1

Despite advances in feature representation, leveraging geometric relations is crucial for establishing reliable visual correspondences under large variations of images. In this work we introduce a Hough transform perspective on convolutional matching and propose an effective geometric matching algorithm, dubbed Convolutional Hough Matching (CHM). The method distributes similarities of candidate matches over a geometric transformation space and evaluate them in a convolutional manner. We cast it into a trainable neural layer with a semi-isotropic high-dimensional kernel, which learns non-rigid matching with a small number of interpretable parameters. To validate the effect, we develop the neural network with CHM layers that perform convolutional matching in the space of translation and scaling. Our method sets a new state of the art on standard benchmarks for semantic visual correspondence, proving its strong robustness to challenging intra-class variations.

READ FULL TEXT

page 7

page 8

page 13

page 14

page 15

page 16

page 17

page 18

research
09/11/2021

Convolutional Hough Matching Networks for Robust and Efficient Visual Correspondence

Despite advances in feature representation, leveraging geometric relatio...
research
07/21/2020

Learning to Compose Hypercolumns for Visual Correspondence

Feature representation plays a crucial role in visual correspondence, an...
research
08/18/2019

Hyperpixel Flow: Semantic Correspondence with Multi-layer Neural Features

Establishing visual correspondences under large intra-class variations r...
research
03/26/2020

Correspondence Networks with Adaptive Neighbourhood Consensus

In this paper, we tackle the task of establishing dense visual correspon...
research
10/06/2022

Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondence

Existing pipelines of semantic correspondence commonly include extractin...
research
03/16/2017

Convolutional neural network architecture for geometric matching

We address the problem of determining correspondences between two images...
research
07/13/2018

Learning-based Natural Geometric Matching with Homography Prior

Geometric matching is a key step in computer vision tasks. Previous lear...

Please sign up or login with your details

Forgot password? Click here to reset