Real-Time Constrained 6D Object-Pose Tracking of An In-Hand Suture Needle for Minimally Invasive Robotic Surgery

by   Zih-Yun Chiu, et al.

Autonomous suturing has been a long-sought-after goal for surgical robotics. Outside of staged environments, accurate localization of suture needles is a critical foundation for automating various suture needle manipulation tasks in the real world. When localizing a needle held by a gripper, previous work usually tracks them separately without considering their relationship. Because of the significant errors that can arise in the stereo-triangulation of objects and instruments, their reconstructions may often not be consistent. This can lead to unrealistic tool-needle grasp reconstructions that are infeasible. Instead, an obvious strategy to improve localization would be to leverage constraints that arise from contact, thereby constraining reconstructions of objects and instruments into a jointly feasible space. In this work, we consider feasible grasping constraints when tracking the 6D pose of an in-hand suture needle. We propose a reparameterization trick to define a new state space for describing a needle pose, where grasp constraints can be easily defined and satisfied. Our proposed state space and feasible grasping constraints are then incorporated into Bayesian filters for real-time needle localization. In the experiments, we show that our constrained methods outperform previous unconstrained/constrained tracking approaches and demonstrate the importance of incorporating feasible grasping constraints into automating suture needle manipulation tasks.


page 1

page 3

page 4

page 6


Robot Learning of Shifting Objects for Grasping in Cluttered Environments

Robotic grasping in cluttered environments is often infeasible due to ob...

Real-time Grasp Pose Estimation for Novel Objects in Densely Cluttered Environment

Grasping of novel objects in pick and place applications is a fundamenta...

In-Hand Object Pose Tracking via Contact Feedback and GPU-Accelerated Robotic Simulation

Tracking the pose of an object while it is being held and manipulated by...

Grasp Constraint Satisfaction for Object Manipulation using Robotic Hands

For successful object manipulation with robotic hands, it is important t...

Dual Quaternion-Based Visual Servoing for Grasping Moving Objects

This paper presents a new dual quaternion-based formulation for pose-bas...

Comparison of Constrained and Unconstrained Human Grasp Forces Using Fingernail Imaging and Visual Servoing

Fingernail imaging has been proven to be effective in prior works [1],[2...

Markerless Suture Needle 6D Pose Tracking with Robust Uncertainty Estimation for Autonomous Minimally Invasive Robotic Surgery

Suture needle localization plays a crucial role towards autonomous sutur...

Please sign up or login with your details

Forgot password? Click here to reset