Learning to Match Features with Seeded Graph Matching Network

by   Hongkai Chen, et al.
Tsinghua University
The Hong Kong University of Science and Technology

Matching local features across images is a fundamental problem in computer vision. Targeting towards high accuracy and efficiency, we propose Seeded Graph Matching Network, a graph neural network with sparse structure to reduce redundant connectivity and learn compact representation. The network consists of 1) Seeding Module, which initializes the matching by generating a small set of reliable matches as seeds. 2) Seeded Graph Neural Network, which utilizes seed matches to pass messages within/across images and predicts assignment costs. Three novel operations are proposed as basic elements for message passing: 1) Attentional Pooling, which aggregates keypoint features within the image to seed matches. 2) Seed Filtering, which enhances seed features and exchanges messages across images. 3) Attentional Unpooling, which propagates seed features back to original keypoints. Experiments show that our method reduces computational and memory complexity significantly compared with typical attention-based networks while competitive or higher performance is achieved.


page 4

page 7

page 10

page 12

page 13


Learning Feature Matching via Matchable Keypoint-Assisted Graph Neural Network

Accurately matching local features between a pair of images is a challen...

Image Keypoint Matching using Graph Neural Networks

Image matching is a key component of many tasks in computer vision and i...

Investigating the Effect of Intraclass Variability in Temporal Ensembling

Temporal Ensembling is a semi-supervised approach that allows training d...

ClusterGNN: Cluster-based Coarse-to-Fine Graph Neural Network for Efficient Feature Matching

Graph Neural Networks (GNNs) with attention have been successfully appli...

AMatFormer: Efficient Feature Matching via Anchor Matching Transformer

Learning based feature matching methods have been commonly studied in re...

Scalable Cluster-Consistency Statistics for Robust Multi-Object Matching

We develop new statistics for robustly filtering corrupted keypoint matc...

Multi-Channel Graph Neural Network for Entity Alignment

Entity alignment typically suffers from the issues of structural heterog...

Please sign up or login with your details

Forgot password? Click here to reset