DeepAI
Log In Sign Up

NeuralMarker: A Framework for Learning General Marker Correspondence

09/19/2022
by   Zhaoyang Huang, et al.
0

We tackle the problem of estimating correspondences from a general marker, such as a movie poster, to an image that captures such a marker. Conventionally, this problem is addressed by fitting a homography model based on sparse feature matching. However, they are only able to handle plane-like markers and the sparse features do not sufficiently utilize appearance information. In this paper, we propose a novel framework NeuralMarker, training a neural network estimating dense marker correspondences under various challenging conditions, such as marker deformation, harsh lighting, etc. Besides, we also propose a novel marker correspondence evaluation method circumstancing annotations on real marker-image pairs and create a new benchmark. We show that NeuralMarker significantly outperforms previous methods and enables new interesting applications, including Augmented Reality (AR) and video editing.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 9

03/25/2021

COTR: Correspondence Transformer for Matching Across Images

We propose a novel framework for finding correspondences in images based...
04/07/2021

LIFE: Lighting Invariant Flow Estimation

We tackle the problem of estimating flow between two images with large l...
12/09/2021

GAN-Supervised Dense Visual Alignment

We propose GAN-Supervised Learning, a framework for learning discriminat...
06/10/2020

3D Human Mesh Regression with Dense Correspondence

Estimating 3D mesh of the human body from a single 2D image is an import...
09/25/2022

ECO-TR: Efficient Correspondences Finding Via Coarse-to-Fine Refinement

Modeling sparse and dense image matching within a unified functional cor...
10/16/2012

Semantic Understanding of Professional Soccer Commentaries

This paper presents a novel approach to the problem of semantic parsing ...
11/20/2021

A Deeper Look into DeepCap

Human performance capture is a highly important computer vision problem ...