Real-time High Resolution Fusion of Depth Maps on GPU

11/28/2013
by   Dmitry Trifonov, et al.
0

A system for live high quality surface reconstruction using a single moving depth camera on a commodity hardware is presented. High accuracy and real-time frame rate is achieved by utilizing graphics hardware computing capabilities via OpenCL and by using sparse data structure for volumetric surface representation. Depth sensor pose is estimated by combining serial texture registration algorithm with iterative closest points algorithm (ICP) aligning obtained depth map to the estimated scene model. Aligned surface is then fused into the scene. Kalman filter is used to improve fusion quality. Truncated signed distance function (TSDF) stored as block-based sparse buffer is used to represent surface. Use of sparse data structure greatly increases accuracy of scanned surfaces and maximum scanning area. Traditional GPU implementation of volumetric rendering and fusion algorithms were modified to exploit sparsity to achieve desired performance. Incorporation of texture registration for sensor pose estimation and Kalman filter for measurement integration improved accuracy and robustness of scanning process.

READ FULL TEXT

page 1

page 2

page 4

page 5

research
08/27/2022

Robust 3D Vision for Autonomous Robots

This paper presents a fault-tolerant 3D vision system for autonomous rob...
research
03/16/2023

Maximum Correntropy Criterion Kalman Filter For Indoor Quadrotor Navigation Under Intermittent Measurements

We present a multisensor fusion framework for the onboard real-time navi...
research
01/09/2014

Hand-guided 3D surface acquisition by combining simple light sectioning with real-time algorithms

Precise 3D measurements of rigid surfaces are desired in many fields of ...
research
09/02/2019

Learned Semantic Multi-Sensor Depth Map Fusion

Volumetric depth map fusion based on truncated signed distance functions...
research
07/29/2018

PSDF Fusion: Probabilistic Signed Distance Function for On-the-fly 3D Data Fusion and Scene Reconstruction

We propose a novel 3D spatial representation for data fusion and scene r...
research
05/05/2021

Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors

Human volumetric capture is a long-standing topic in computer vision and...
research
06/20/2022

Reconstruction and segmentation from sparse sequential X-ray measurements of wood logs

In industrial applications it is common to scan objects on a moving conv...

Please sign up or login with your details

Forgot password? Click here to reset