Learning to Remove Multipath Distortions in Time-of-Flight Range Images for a Robotic Arm Setup

01/08/2016
by   Kilho Son, et al.
0

Range images captured by Time-of-Flight (ToF) cameras are corrupted with multipath distortions due to interaction between modulated light signals and scenes. The interaction is often complicated, which makes a model-based solution elusive. We propose a learning-based approach for removing the multipath distortions for a ToF camera in a robotic arm setup. Our approach is based on deep learning. We use the robotic arm to automatically collect a large amount of ToF range images containing various multipath distortions. The training images are automatically labeled by leveraging a high precision structured light sensor available only in the training time. In the test time, we apply the learned model to remove the multipath distortions. This allows our robotic arm setup to enjoy the speed and compact form of the ToF camera without compromising with its range measurement errors. We conduct extensive experimental validations and compare the proposed method to several baseline algorithms. The experiment results show that our method achieves 55 reduction in range estimation and largely outperforms the baseline algorithms.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 8

research
09/07/2023

A Food Package Recognition and Sorting System Based on Structured Light and Deep Learning

Vision algorithm-based robotic arm grasping system is one of the robotic...
research
01/05/2020

Arduino based Voice controlled Robotic Arm

The aim of this work is to present an inexpensive, light-weight and easi...
research
09/30/2009

Improvements of the 3D images captured with Time-of-Flight cameras

3D Time-of-Flight camera's images are affected by errors due to the diff...
research
12/12/2020

An Overview of Depth Cameras and Range Scanners Based on Time-of-Flight Technologies

Time-of-flight (TOF) cameras are sensors that can measure the depths of ...
research
02/23/2017

A Computational Model of a Single-Photon Avalanche Diode Sensor for Transient Imaging

Single-Photon Avalanche Diodes (SPAD) are affordable photodetectors, cap...
research
11/24/2022

Channel Optimized Visual Imagery based Robotic Arm Control under the Online Environment

An electroencephalogram is an effective approach that provides a bidirec...
research
01/19/2023

Regularizing disparity estimation via multi task learning with structured light reconstruction

3D reconstruction is a useful tool for surgical planning and guidance. H...

Please sign up or login with your details

Forgot password? Click here to reset