Comparison of Depth Estimation Setups from Stereo Endoscopy and Optical Tracking for Point Measurements

01/26/2022
by   Lukas Burger, et al.
0

To support minimally-invasive intraoperative mitral valve repair, quantitative measurements from the valve can be obtained using an infra-red tracked stylus. It is desirable to view such manually measured points together with the endoscopic image for further assistance. Therefore, hand-eye calibration is required that links both coordinate systems and is a prerequisite to project the points onto the image plane. A complementary approach to this is to use a vision-based endoscopic stereo-setup to detect and triangulate points of interest, to obtain the 3D coordinates. In this paper, we aim to compare both approaches on a rigid phantom and two patient-individual silicone replica which resemble the intraoperative scenario. The preliminary results indicate that 3D landmark estimation, either labeled manually or through partly automated detection with a deep learning approach, provides more accurate triangulated depth measurements when performed with a tailored image-based method than with stylus measurements.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/19/2020

Depth Estimation by Learning Triangulation and Densification of Sparse Points for Multi-view Stereo

Multi-view stereo (MVS) is the golden mean between the accuracy of activ...
research
09/20/2018

Real Time Dense Depth Estimation by Fusing Stereo with Sparse Depth Measurements

We present an approach to depth estimation that fuses information from a...
research
08/22/2021

SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation

3D detection plays an indispensable role in environment perception. Due ...
research
03/26/2019

High-Precision Online Markerless Stereo Extrinsic Calibration

Stereo cameras and dense stereo matching algorithms are core components ...
research
05/13/2023

Seeing Through the Grass: Semantic Pointcloud Filter for Support Surface Learning

Mobile ground robots require perceiving and understanding their surround...
research
05/15/2017

Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo

We present a novel solution to the problem of 3D tracking of the articul...

Please sign up or login with your details

Forgot password? Click here to reset