Occlusion-robust Visual Markerless Bone Tracking for Computer-Assisted Orthopaedic Surgery

08/24/2021
by   Xue Hu, et al.
17

Conventional computer-assisted orthopaedic navigation systems rely on the tracking of dedicated optical markers for patient poses, which makes the surgical workflow more invasive, tedious, and expensive. Visual tracking has recently been proposed to measure the target anatomy in a markerless and effortless way, but the existing methods fail under real-world occlusion caused by intraoperative interventions. Furthermore, such methods are hardware-specific and not accurate enough for surgical applications. In this paper, we propose a RGB-D sensing-based markerless tracking method that is robust against occlusion. We design a new segmentation network that features dynamic region-of-interest prediction and robust 3D point cloud segmentation. As it is expensive to collect large-scale training data with occlusion instances, we also propose a new method to create synthetic RGB-D images for network training. Experimental results show that our proposed markerless tracking method outperforms recent state-of-the-art approaches by a large margin, especially when an occlusion exists. Furthermore, our method generalises well to new cameras and new target models, including a cadaver, without the need for network retraining. In practice, by using a high-quality commercial RGB-D camera, our proposed visual tracking method achieves an accuracy of 1-2 degress and 2-4 mm on a model knee, which meets the standard for clinical applications.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

page 9

research
05/05/2023

Next-generation Surgical Navigation: Multi-view Marker-less 6DoF Pose Estimation of Surgical Instruments

State-of-the-art research of traditional computer vision is increasingly...
research
06/04/2019

State-aware Re-identification Feature for Multi-target Multi-camera Tracking

Multi-target Multi-camera Tracking (MTMCT) aims to extract the trajector...
research
07/22/2017

Clinical Patient Tracking in the Presence of Transient and Permanent Occlusions via Geodesic Feature

This paper develops a method to use RGB-D cameras to track the motions o...
research
04/04/2019

Generic Multiview Visual Tracking

Recent progresses in visual tracking have greatly improved the tracking ...
research
11/27/2018

Object Tracking by Reconstruction with View-Specific Discriminative Correlation Filters

Standard RGB-D trackers treat the target as an inherently 2D structure, ...
research
11/21/2022

Twin-S: A Digital Twin for Skull-base Surgery

Purpose: Digital twins are virtual interactive models of the real world,...
research
06/30/2022

Sonification as a Reliable Alternative to Conventional Visual Surgical Navigation

Despite the undeniable advantages of image-guided surgical assistance sy...

Please sign up or login with your details

Forgot password? Click here to reset