Iterative Clustering with Game-Theoretic Matching for Robust Multi-consistency Correspondence

09/03/2019
by   Chen Zhao, et al.
5

Matching corresponding features between two images is a fundamental task to computer vision with numerous applications in object recognition, robotics, and 3D reconstruction. Current state of the art in image feature matching has focused on establishing a single consistency in static scenes; by contrast, finding multiple consistencies in dynamic scenes has been under-researched. In this paper, we present an end-to-end optimization framework named "iterative clustering with Game-Theoretic Matching" (ic-GTM) for robust multi-consistency correspondence. The key idea is to formulate multi-consistency matching as a generalized clustering problem for an image pair. In our formulation, several local matching games are simultaneously carried out in different corresponding block pairs under the guidance of a novel payoff function consisting of both geometric and descriptive compatibility; the global matching results are further iteratively refined by clustering and thresholding with respect to a payoff matrix. We also propose three new metrics for evaluating the performance of multi-consistency image feature matching. Extensive experimental results have shown that the proposed framework significantly outperforms previous state-of-the-art approaches on both singleconsistency and multi-consistency datasets.

READ FULL TEXT

page 3

page 5

page 7

page 11

page 12

research
01/07/2019

All Graphs Lead to Rome: Learning Geometric and Cycle-Consistent Representations with Graph Convolutional Networks

Image feature matching is a fundamental part of many geometric computer ...
research
01/03/2019

Local Area Transform for Cross-Modality Correspondence Matching and Deep Scene Recognition

Establishing correspondences is a fundamental task in variety of image p...
research
12/07/2017

Multi-layer Random Walks Synchronization for Multi-attributed Multiple Graph Matching

Many applications in computer vision can be formulated as a multiple gra...
research
06/19/2017

Histograms of Gaussian normal distribution for feature matching in clutter scenes

3D feature descriptor provide information between corresponding models a...
research
09/16/2020

GOCor: Bringing Globally Optimized Correspondence Volumes into Your Neural Network

The feature correlation layer serves as a key neural network module in n...
research
06/04/2021

Stochastic Iterative Graph Matching

Recent works leveraging Graph Neural Networks to approach graph matching...
research
08/07/2018

MatchBench: An Evaluation of Feature Matchers

Feature matching is one of the most fundamental and active research area...

Please sign up or login with your details

Forgot password? Click here to reset