Joint Deep Multi-Graph Matching and 3D Geometry Learning from Inhomogeneous 2D Image Collections

03/31/2021
by   Zhenzhang Ye, et al.
0

Graph matching aims to establish correspondences between vertices of graphs such that both the node and edge attributes agree. Various learning-based methods were recently proposed for finding correspondences between image key points based on deep graph matching formulations. While these approaches mainly focus on learning node and edge attributes, they completely ignore the 3D geometry of the underlying 3D objects depicted in the 2D images. We fill this gap by proposing a trainable framework that takes advantage of graph neural networks for learning a deformable 3D geometry model from inhomogeneous image collections, i.e. a set of images that depict different instances of objects from the same category. Experimentally we demonstrate that our method outperforms recent learning-based approaches for graph matching considering both accuracy and cycle-consistency error, while we in addition obtain the underlying 3D geometry of the objects depicted in the 2D images.

READ FULL TEXT

page 1

page 5

page 7

page 13

research
05/27/2022

Image Keypoint Matching using Graph Neural Networks

Image matching is a key component of many tasks in computer vision and i...
research
12/01/2022

Universe Points Representation Learning for Partial Multi-Graph Matching

Many challenges from natural world can be formulated as a graph matching...
research
03/22/2023

LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signals

Finding localized correspondences across different images of the same ob...
research
06/17/2021

Discovering Relationships between Object Categories via Universal Canonical Maps

We tackle the problem of learning the geometry of multiple categories of...
research
11/08/2022

AEDNet: Adaptive Edge-Deleting Network For Subgraph Matching

Subgraph matching is to find all subgraphs in a data graph that are isom...
research
01/07/2019

All Graphs Lead to Rome: Learning Geometric and Cycle-Consistent Representations with Graph Convolutional Networks

Image feature matching is a fundamental part of many geometric computer ...
research
01/26/2022

On the Power of Gradual Network Alignment Using Dual-Perception Similarities

Network alignment (NA) is the task of finding the correspondence of node...

Please sign up or login with your details

Forgot password? Click here to reset