A Non-Rigid Map Fusion-Based RGB-Depth SLAM Method for Endoscopic Capsule Robots

05/15/2017
by   Mehmet Turan, et al.
0

In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is considered as a minimally invasive novel diagnostic technology to inspect the entire GI tract and to diagnose various diseases and pathologies. Since the development of this technology, medical device companies and many groups have made significant progress to turn such passive capsule endoscopes into robotic active capsule endoscopes to achieve almost all functions of current active flexible endoscopes. However, the use of robotic capsule endoscopy still has some challenges. One such challenge is the precise localization of such active devices in 3D world, which is essential for a precise three-dimensional (3D) mapping of the inner organ. A reliable 3D map of the explored inner organ could assist the doctors to make more intuitive and correct diagnosis. In this paper, we propose to our knowledge for the first time in literature a visual simultaneous localization and mapping (SLAM) method specifically developed for endoscopic capsule robots. The proposed RGB-Depth SLAM method is capable of capturing comprehensive dense globally consistent surfel-based maps of the inner organs explored by an endoscopic capsule robot in real time. This is achieved by using dense frame-to-model camera tracking and windowed surfelbased fusion coupled with frequent model refinement through non-rigid surface deformations.

READ FULL TEXT

page 8

page 13

page 19

research
05/17/2017

Magnetic-Visual Sensor Fusion based Medical SLAM for Endoscopic Capsule Robot

A reliable, real-time simultaneous localization and mapping (SLAM) metho...
research
03/02/2018

Magnetic-Visual Sensor Fusion-based Dense 3D Reconstruction and Localization for Endoscopic Capsule Robots

Reliable and real-time 3D reconstruction and localization functionality ...
research
08/22/2017

Deep EndoVO: A Recurrent Convolutional Neural Network (RCNN) based Visual Odometry Approach for Endoscopic Capsule Robots

Ingestible wireless capsule endoscopy is an emerging minimally invasive ...
research
08/25/2021

Adaptive Simultaneous Magnetic Actuation and Localization for WCE in a Tubular Environment

Simultaneous Magnetic Actuation and Localization (SMAL) is a promising t...
research
05/15/2017

A Deep Learning Based 6 Degree-of-Freedom Localization Method for Endoscopic Capsule Robots

We present a robust deep learning based 6 degrees-of-freedom (DoF) local...
research
08/16/2018

Simultaneous Localization And Mapping with depth Prediction using Capsule Networks for UAVs

In this paper, we propose an novel implementation of a simultaneous loca...

Please sign up or login with your details

Forgot password? Click here to reset