Depth Estimation from Single-shot Monocular Endoscope Image Using Image Domain Adaptation And Edge-Aware Depth Estimation

01/12/2022
by   Masahiro Oda, et al.
16

We propose a depth estimation method from a single-shot monocular endoscopic image using Lambertian surface translation by domain adaptation and depth estimation using multi-scale edge loss. We employ a two-step estimation process including Lambertian surface translation from unpaired data and depth estimation. The texture and specular reflection on the surface of an organ reduce the accuracy of depth estimations. We apply Lambertian surface translation to an endoscopic image to remove these texture and reflections. Then, we estimate the depth by using a fully convolutional network (FCN). During the training of the FCN, improvement of the object edge similarity between an estimated image and a ground truth depth image is important for getting better results. We introduced a muti-scale edge loss function to improve the accuracy of depth estimation. We quantitatively evaluated the proposed method using real colonoscopic images. The estimated depth values were proportional to the real depth values. Furthermore, we applied the estimated depth images to automated anatomical location identification of colonoscopic images using a convolutional neural network. The identification accuracy of the network improved from 69.2

READ FULL TEXT

page 3

page 8

page 9

research
12/27/2021

Depth estimation of endoscopy using sim-to-real transfer

In order to use the navigation system effectively, distance information ...
research
07/16/2021

CutDepth:Edge-aware Data Augmentation in Depth Estimation

It is difficult to collect data on a large scale in a monocular depth es...
research
09/03/2020

DESC: Domain Adaptation for Depth Estimation via Semantic Consistency

Accurate real depth annotations are difficult to acquire, needing the us...
research
11/24/2020

Variational Monocular Depth Estimation for Reliability Prediction

Self-supervised learning for monocular depth estimation is widely invest...
research
10/03/2019

A Neural Network for Detailed Human Depth Estimation from a Single Image

This paper presents a neural network to estimate a detailed depth map of...
research
03/04/2022

3D endoscopic depth estimation using 3D surface-aware constraints

Robotic-assisted surgery allows surgeons to conduct precise surgical ope...
research
05/16/2019

How do neural networks see depth in single images?

Deep neural networks have lead to a breakthrough in depth estimation fro...

Please sign up or login with your details

Forgot password? Click here to reset