μ-MAR: Multiplane 3D Marker based Registration for Depth-sensing Cameras

08/04/2017
by   Marcelo Saval-Calvo, et al.
0

Many applications including object reconstruction, robot guidance, and scene mapping require the registration of multiple views from a scene to generate a complete geometric and appearance model of it. In real situations, transformations between views are unknown an it is necessary to apply expert inference to estimate them. In the last few years, the emergence of low-cost depth-sensing cameras has strengthened the research on this topic, motivating a plethora of new applications. Although they have enough resolution and accuracy for many applications, some situations may not be solved with general state-of-the-art registration methods due to the Signal-to-Noise ratio (SNR) and the resolution of the data provided. The problem of working with low SNR data, in general terms, may appear in any 3D system, then it is necessary to propose novel solutions in this aspect. In this paper, we propose a method, μ-MAR, able to both coarse and fine register sets of 3D points provided by low-cost depth-sensing cameras, despite it is not restricted to these sensors, into a common coordinate system. The method is able to overcome the noisy data problem by means of using a model-based solution of multiplane registration. Specifically, it iteratively registers 3D markers composed by multiple planes extracted from points of multiple views of the scene. As the markers and the object of interest are static in the scenario, the transformations obtained for the markers are applied to the object in order to reconstruct it. Experiments have been performed using synthetic and real data. The synthetic data allows a qualitative and quantitative evaluation by means of visual inspection and Hausdorff distance respectively. The real data experiments show the performance of the proposal using data acquired by a Primesense Carmine RGB-D sensor. The method has been compared to several state-of-the-art methods. The ...

READ FULL TEXT

page 22

page 25

page 27

page 29

page 30

page 32

research
02/05/2018

3D non-rigid registration using color: Color Coherent Point Drift

Research into object deformations using computer vision techniques has b...
research
07/23/2021

Photon-Starved Scene Inference using Single Photon Cameras

Scene understanding under low-light conditions is a challenging problem....
research
06/19/2019

Learning to Reconstruct and Understand Indoor Scenes from Sparse Views

This paper proposes a new method for simultaneous 3D reconstruction and ...
research
01/09/2014

Hand-guided 3D surface acquisition by combining simple light sectioning with real-time algorithms

Precise 3D measurements of rigid surfaces are desired in many fields of ...
research
02/10/2016

Super-Resolved Retinal Image Mosaicing

The acquisition of high-resolution retinal fundus images with a large fi...
research
03/12/2021

iToF2dToF: A Robust and Flexible Representation for Data-Driven Time-of-Flight Imaging

Indirect Time-of-Flight (iToF) cameras are a promising depth sensing tec...
research
07/23/2023

Simultaneous temperature estimation and nonuniformity correction from multiple frames

Infrared (IR) cameras are widely used for temperature measurements in va...

Please sign up or login with your details

Forgot password? Click here to reset