Self-Supervised Correspondence Estimation via Multiview Registration

12/06/2022
by   Mohamed El Banani, et al.
0

Video provides us with the spatio-temporal consistency needed for visual learning. Recent approaches have utilized this signal to learn correspondence estimation from close-by frame pairs. However, by only relying on close-by frame pairs, those approaches miss out on the richer long-range consistency between distant overlapping frames. To address this, we propose a self-supervised approach for correspondence estimation that learns from multiview consistency in short RGB-D video sequences. Our approach combines pairwise correspondence estimation and registration with a novel SE(3) transformation synchronization algorithm. Our key insight is that self-supervised multiview registration allows us to obtain correspondences over longer time frames; increasing both the diversity and difficulty of sampled pairs. We evaluate our approach on indoor scenes for correspondence estimation and RGB-D pointcloud registration and find that we perform on-par with supervised approaches.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 13

page 14

research
06/01/2021

Bootstrap Your Own Correspondences

Geometric feature extraction is a crucial component of point cloud regis...
research
02/28/2018

Retrieval and Registration of Long-Range Overlapping Frames for Scalable Mosaicking of In Vivo Fetoscopy

Purpose: The standard clinical treatment of Twin-to-Twin Transfusion Syn...
research
05/02/2019

Self-supervised Learning for Video Correspondence Flow

The objective of this paper is self-supervised learning of feature embed...
research
06/25/2020

Space-Time Correspondence as a Contrastive Random Walk

This paper proposes a simple self-supervised approach for learning repre...
research
05/13/2023

Temporal Consistent Automatic Video Colorization via Semantic Correspondence

Video colorization task has recently attracted wide attention. Recent me...
research
09/28/2021

Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learning

This paper presents a self-supervised method for learning reliable visua...
research
07/28/2016

Fine-To-Coarse Global Registration of RGB-D Scans

RGB-D scanning of indoor environments is important for many applications...

Please sign up or login with your details

Forgot password? Click here to reset