Combining Deep Learning with Geometric Features for Image based Localization in the Gastrointestinal Tract

05/11/2020
by   Jingwei Song, et al.
0

Tracking monocular colonoscope in the Gastrointestinal tract (GI) is a challenging problem as the images suffer from deformation, blurred textures, significant changes in appearance. They greatly restrict the tracking ability of conventional geometry based methods. Even though Deep Learning (DL) can overcome these issues, limited labeling data is a roadblock to state-of-art DL method. Considering these, we propose a novel approach to combine DL method with traditional feature based approach to achieve better localization with small training data. Our method fully exploits the best of both worlds by introducing a Siamese network structure to perform few-shot classification to the closest zone in the segmented training image set. The classified label is further adopted to initialize the pose of scope. To fully use the training dataset, a pre-generated triangulated map points within the zone in the training set are registered with observation and contribute to estimating the optimal pose of the test image. The proposed hybrid method is extensively tested and compared with existing methods, and the result shows significant improvement over traditional geometric based or DL based localization. The accuracy is improved by 28.94 to state-of-art method.

READ FULL TEXT

page 2

page 7

research
01/05/2022

Fusing Convolutional Neural Network and Geometric Constraint for Image-based Indoor Localization

This paper proposes a new image-based localization framework that explic...
research
12/04/2017

GANerated Hands for Real-time 3D Hand Tracking from Monocular RGB

We address the highly challenging problem of real-time 3D hand tracking ...
research
08/14/2023

SEMI-CenterNet: A Machine Learning Facilitated Approach for Semiconductor Defect Inspection

Continual shrinking of pattern dimensions in the semiconductor domain is...
research
06/15/2018

Three dimensional Deep Learning approach for remote sensing image classification

Recently, a variety of approaches has been enriching the field of Remote...
research
08/01/2023

Space Debris: Are Deep Learning-based Image Enhancements part of the Solution?

The volume of space debris currently orbiting the Earth is reaching an u...
research
12/02/2019

Deep Learning for Visual Tracking: A Comprehensive Survey

Visual target tracking is one of the most sought-after yet challenging r...
research
01/26/2022

A Multi-rater Comparative Study of Automatic Target Localization Methods for Epilepsy Deep Brain Stimulation Procedures

Epilepsy is the fourth most common neurological disorder and affects peo...

Please sign up or login with your details

Forgot password? Click here to reset