Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgery

06/14/2021
by   Jingwei Song, et al.
19

This paper reports a CPU-level real-time stereo matching method for surgical images (10 Hz on 640 * 480 image with a single core of i5-9400). The proposed method is built on the fast ”dense inverse searching” algorithm, which estimates the disparity of the stereo images. The overlapping image patches (arbitrary squared image segment) from the images at different scales are aligned based on the photometric consistency presumption. We propose a Bayesian framework to evaluate the probability of the optimized patch disparity at different scales. Moreover, we introduce a spatial Gaussian mixed probability distribution to address the pixel-wise probability within the patch. In-vivo and synthetic experiments show that our method can handle ambiguities resulted from the textureless surfaces and the photometric inconsistency caused by the Lambertian reflectance. Our Bayesian method correctly balances the probability of the patch for stereo images at different scales. Experiments indicate that the estimated depth has higher accuracy and fewer outliers than the baseline methods in the surgical scenario.

READ FULL TEXT

page 3

page 5

page 6

research
05/06/2022

BDIS: Bayesian Dense Inverse Searching Method for Real-Time Stereo Surgical Image Matching

In stereoscope-based Minimally Invasive Surgeries (MIS), dense stereo ma...
research
10/02/2019

Learning Dense Wide Baseline Stereo Matching for People

Existing methods for stereo work on narrow baseline image pairs giving l...
research
06/11/2019

TW-SMNet: Deep Multitask Learning of Tele-Wide Stereo Matching

In this paper, we introduce the problem of estimating the real world dep...
research
01/21/2020

Depth-Based Selective Blurring in Stereo Images Using Accelerated Framework

We propose a hybrid method for stereo disparity estimation by combining ...
research
12/22/2020

SERV-CT: A disparity dataset from CT for validation of endoscopic 3D reconstruction

In computer vision, reference datasets have been highly successful in pr...
research
06/27/2014

3D planar patch extraction from stereo using probabilistic region growing

This article presents a novel 3D planar patch extraction method using a ...
research
08/21/2021

L3C-Stereo: Lossless Compression for Stereo Images

A large number of autonomous driving tasks need high-definition stereo i...

Please sign up or login with your details

Forgot password? Click here to reset