Uncertainty-aware Self-supervised Learning for Cross-domain Technical Skill Assessment in Robot-assisted Surgery

04/28/2023
by   Ziheng Wang, et al.
0

Objective technical skill assessment is crucial for effective training of new surgeons in robot-assisted surgery. With advancements in surgical training programs in both physical and virtual environments, it is imperative to develop generalizable methods for automatically assessing skills. In this paper, we propose a novel approach for skill assessment by transferring domain knowledge from labeled kinematic data to unlabeled data. Our approach leverages labeled data from common surgical training tasks such as Suturing, Needle Passing, and Knot Tying to jointly train a model with both labeled and unlabeled data. Pseudo labels are generated for the unlabeled data through an iterative manner that incorporates uncertainty estimation to ensure accurate labeling. We evaluate our method on a virtual reality simulated training task (Ring Transfer) using data from the da Vinci Research Kit (dVRK). The results show that trainees with robotic assistance have significantly higher expert probability compared to these without any assistance, p < 0.05, which aligns with previous studies showing the benefits of robotic assistance in improving training proficiency. Our method offers a significant advantage over other existing works as it does not require manual labeling or prior knowledge of the surgical training task for robot-assisted surgery.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 8

page 10

research
03/06/2019

Video-based surgical skill assessment using 3D convolutional neural networks

Purpose: A profound education of novice surgeons is crucial to ensure th...
research
03/03/2019

DESK: A Robotic Activity Dataset for Dexterous Surgical Skills Transfer to Medical Robots

Datasets are an essential component for training effective machine learn...
research
11/16/2016

Machine Learning Approach for Skill Evaluation in Robotic-Assisted Surgery

Evaluating surgeon skill has predominantly been a subjective task. Devel...
research
09/23/2021

Robot-Assisted Surgical Training Over Several Days in a Virtual Surgical Environment with Divergent and Convergent Force Fields

Surgical procedures require a high level of technical skill to ensure ef...
research
10/24/2022

Caveats on the first-generation da Vinci Research Kit: latent technical constraints and essential calibrations

Telesurgical robotic systems provide a well established form of assistan...
research
12/22/2017

Automated Surgical Skill Assessment in RMIS Training

Purpose: Manual feedback in basic RMIS training can consume a significan...
research
06/12/2019

Transferrable Operative Difficulty Assessment in Robot-assisted Teleoperation: A Domain Adaptation Approach

Providing an accurate and efficient assessment of operative difficulty i...

Please sign up or login with your details

Forgot password? Click here to reset