Lighting Enhancement Aids Reconstruction of Colonoscopic Surfaces

03/18/2021
by   Yubo Zhang, et al.
8

High screening coverage during colonoscopy is crucial to effectively prevent colon cancer. Previous work has allowed alerting the doctor to unsurveyed regions by reconstructing the 3D colonoscopic surface from colonoscopy videos in real-time. However, the lighting inconsistency of colonoscopy videos can cause a key component of the colonoscopic reconstruction system, the SLAM optimization, to fail. In this work we focus on the lighting problem in colonoscopy videos. To successfully improve the lighting consistency of colonoscopy videos, we have found necessary a lighting correction that adapts to the intensity distribution of recent video frames. To achieve this in real-time, we have designed and trained an RNN network. This network adapts the gamma value in a gamma-correction process. Applied in the colonoscopic surface reconstruction system, our light-weight model significantly boosts the reconstruction success rate, making a larger proportion of colonoscopy video segments reconstructable and improving the reconstruction quality of the already reconstructed segments.

READ FULL TEXT

page 2

page 5

page 7

page 10

research
10/19/2022

Estimating the coverage in 3d reconstructions of the colon from colonoscopy videos

Colonoscopy is the most common procedure for early detection and removal...
research
02/16/2011

An Efficient and Integrated Algorithm for Video Enhancement in Challenging Lighting Conditions

We describe a novel integrated algorithm for real-time enhancement of vi...
research
04/17/2020

An integrated light management system with real-time light measurement and human perception

Illumination is important for well-being, productivity and safety across...
research
04/01/2021

Neural Video Portrait Relighting in Real-time via Consistency Modeling

Video portraits relighting is critical in user-facing human photography,...
research
11/19/2021

ColDE: A Depth Estimation Framework for Colonoscopy Reconstruction

One of the key elements of reconstructing a 3D mesh from a monocular vid...
research
05/17/2023

Colonoscopy Coverage Revisited: Identifying Scanning Gaps in Real-Time

Colonoscopy is the most widely used medical technique for preventing Col...
research
03/10/2023

Accurate Real-time Polyp Detection in Videos from Concatenation of Latent Features Extracted from Consecutive Frames

An efficient deep learning model that can be implemented in real-time fo...

Please sign up or login with your details

Forgot password? Click here to reset