SERV-CT: A disparity dataset from CT for validation of endoscopic 3D reconstruction

12/22/2020
by   P. J. "Eddie'' Edwards, et al.
10

In computer vision, reference datasets have been highly successful in promoting algorithmic development in stereo reconstruction. Surgical scenes gives rise to specific problems, including the lack of clear corner features, highly specular surfaces and the presence of blood and smoke. Publicly available datasets have been produced using CT and either phantom images or biological tissue samples covering a relatively small region of the endoscope field-of-view. We present a stereo-endoscopic reconstruction validation dataset based on CT (SERV-CT). Two ex vivo small porcine full torso cadavers were placed within the view of the endoscope with both the endoscope and target anatomy visible in the CT scan. Orientation of the endoscope was manually aligned to the stereoscopic view. Reference disparities and occlusions were calculated for 8 stereo pairs from each sample. For the second sample an RGB surface was acquired to aid alignment of smooth, featureless surfaces. Repeated manual alignments showed an RMS disparity accuracy of  2 pixels and a depth accuracy of  2mm. The reference dataset includes endoscope image pairs with corresponding calibration, disparities, depths and occlusions covering the majority of the endoscopic image and a range of tissue types. Smooth specular surfaces and images with significant variation of depth are included. We assessed the performance of various stereo algorithms from online available repositories. There is a significant variation between algorithms, highlighting some of the challenges of surgical endoscopic images. The SERV-CT dataset provides an easy to use stereoscopic validation for surgical applications with smooth reference disparities and depths with coverage over the majority of the endoscopic images. This complements existing resources well and we hope will aid the development of surgical endoscopic anatomical reconstruction algorithms.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

page 10

page 13

11/30/2021

PlantStereo: A Stereo Matching Benchmark for Plant Surface Dense Reconstruction

Stereo matching is an important task in computer vision which has drawn ...
07/09/2019

A New Stereo Benchmarking Dataset for Satellite Images

In order to facilitate further research in stereo reconstruction with mu...
10/08/2021

Stereo Dense Scene Reconstruction and Accurate Laparoscope Localization for Learning-Based Navigation in Robot-Assisted Surgery

The computation of anatomical information and laparoscope position is a ...
06/14/2021

Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgery

This paper reports a CPU-level real-time stereo matching method for surg...
08/29/2016

ORBSLAM-based Endoscope Tracking and 3D Reconstruction

We aim to track the endoscope location inside the surgical scene and pro...
06/30/2022

Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery

Reconstruction of the soft tissues in robotic surgery from endoscopic st...
12/05/2021

Real-time Virtual Intraoperative CT for Image Guided Surgery

Abstract. Purpose: This paper presents a scheme for generating virtual i...

Code Repositories

servcttk

Evaluation toolkit for the SERV-CT Dataset


view repo